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ABSTRACT 


In recent years, there has been a considerable increase in both the 
variety and number of sensors which needed to be tied together. A new 
distributed estimation architecture for Distributed Sensors Networks (DSN) is 
introduced. It is called Horizontai Estimation Architecture (HEA). The term 
horizontal is usec to imply that the geographically dispersed nodes do not 
differ in rank and are peer-to-peer coupled. Each node is connected by a 
data link to its neighbors (where possible), thus providing a mesh network 
topology. The introduced HEA has four major components, the locai 
estimator, the information fusion process (both together are called a 
horizontal estimator), the network access protocol, and the controller- 
decisionmaker. 

The HEA techniques are applied to the solution of Multitarget and 
Multisensor Tracking (MMT) problems in Track-While-Scan (TWS) systems 
with an emphasis towards track fusion. A mathematical framework which 
encompasses the components of the horizontal estimator is developed, with 
an emphasis towards the track fusion algorithm. An artificial intelligence 
approach using expert systems for track fusion has been presented. Through 
this HEA application its main features and practical usefulness are 


addressed. 
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[. INTRODUCTION 


In recent years, there has Deen an increasing interest in Distributed 
Sensors Networks (DSN). Examples can be found in Air Traffic Control (ATC) 
systems, surveillance systems, and air defence systems. In these systems, 
computers are sited essentiaily at the sensor sites, or in the display system, 
and in the command and control areas. As a consequence, a distributed 
sensors network implies a computer network, which ensures performance of 
data processing, organization of information display, and the communication 
between the different aetwork components, in addition to an estimation and 


decision making processes. 


A. MAIN DSN DEVELOPMENT ISSUES 
There are many different issues which arise in the development of a 
DSN. The fundamental issues are: 
1. The design of muitisensor architectures. 


2. How much local processing capability should a sensor have, and how 
should the data communicated by a sensor be summarized and 
comoressed? 


. The procedures for data fusion. 


. The performance evaluation of a multisensor configuration. 


LA ob 


. The on-line management/control of an impiemented multisensors 
network. 


6. Provision of software and hardware, bearing in mind the growing, 
restructuring and reconfiguration capabilities. 
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These issues are difficult. They become more so in the muititarget 
environment faced in aircraft, missile, battlefield, and ocean surveillance. In 
these environments, there is the added problem of data association. That is, 
given a piece of data, one must determine to what it should be attributed. 
Should it be one of the current objects being considered, and if so, which? or, 
should it be a new object, or a false alarm? 

General architectures of muitisensor networks are centralized and 
distributed. Severai problems arise in the analysis and design of the 
mentioned architectures, among them are: 


a. Air-Space management, i.e, allotment of airspace sectors to the 
sensors of the network. 


b. Gathering, routing, management and dissemination of data and 
results througn the communication network. 


c. Organization of sensors and processors. 


B. REQUIREMENTS FOR DEVELOPMENT OF DSN 

There are technological advances in several disciplines, which are 
providing tools for designers of DSN. An adequate development of DSN 
requires the successful integration of these disciplines, e.g, modern theory of 
systems and control, computer science, communications, man- machine 
interactions, expert systems, information systems, reltability and 
maintainability. In defense systems especially, there is an increasing 
interest in simuitaneousiy using various types of sensing techniques co- 
operating with each other, such as various types of radars, infrared detecting 
passive radio surveillance, and laser systems. The combination gives rise to 
a system concept which requires location of objects and detection over a 


wide frequency spectrum. This decreases the effect of unintentional and 
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intentional interferences, and increases the system reliability and 
survivability. In addition, the use of passive sensors improves the system's 
covertness. Also, a defense system is required to remain reliable and secure 
in the presence of intense hostile activity, which will probably include 
destructive actions. 

Today, the communication is both slower and more costly than 
computation and processing. Present trends indicate that these imbalances 
in speed and costs of communications and processing will not only continue 
but are likely to greatly increase [Ref. 1]. Military communication systems 
are generally designed and tested in a peacetime setting. However, their 
greatest test will come in a conflict situation, when the need to communicate 
becomes great and hostile enemy actions, including physical destruction and 
electronic countermeasures will create node and link failures and a 
dynamically changing network topology. So, one of the prime motivations in 
DSN is to try to minimize the communication load between different sites or 
nodes. 

Since the sensors are the means by which a decision making process 
observes the environment , which is generally a dynamically changing 
environment in the presence of uncertainties, sensor measurements are used 
to reduce these uncertainties, and determine the current state of the system. 
So, DSN implicitly includes an estimation process in addition to a decision 
making process. The future trends of decision making in complex 
technoicgical environments are towards decentralized strategies. These 


trends are being supported by the fruitful progress in the direction of 


Be) 


distributed computer architectures, distributed data processing, distributed 
knowledge based systems and fifth generation computers. 

The Japanese Fifth Generation Computer Systems (FGCS) project is 
directed toward nonnumeric applications. The more traditional systems 
application of number crunching is not an issue in the FGCS. It is expected 
that the supercomputers being developed today will perform these tasks. 
The FGGS project is directed instead toward applied artificial intelligence and 
symbol manipulation. In other words, the next generation of computers is 
being designed to manipulate knowledge. It will employ and exploit 


knowledge-based system technology. 


C. DISTRIBUTED ESTIMATION AECHITECTURES 

A distributed estimation architecture for DSN is introduced bearing in 
mind previously mentioned considerations. Research in distributed 
estimation has progressed along several directions. A survey of these 
directions can be found in the paper by Chong, Tse and Mori [Ref. 2], and its 
references [Ref. 3,4,5,6]. The estimation architectures used are mainly 
hierarchical and centralized. In our approach, the Horizontal Estimation 
Architecture ( HEA ) is introduced. The term horizontal is used to imply that 
the geographically dispersed nodes do not differ in rank. They are of equal 
Status and peer- to - peer coupled, and emphasizing the nonhierarchical 
architecture used. 

The practical usefuiness and the performance of HEA techiques are better 
described with reference to the particular applications for which they are 
designed. Multitarget Multisensor Tracking (MMT) problems in Track- 
While-Scan (TWS) systems, has been selected as a specific problem to be 
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addressed, emphasising the infor mation (track) fusion process. A 
mathematical model for MMT is presented. An algorithm for pairwise track 
fusion is derived and the optimality of HEA track fusion is justified. An 
artificial intelligence approach using expert systems for track fusion has 
been presented. Through the HEA application its main features and practica! 


usefulness are addressed. 





CENTRAL 
ESTIMATOR 


FIGURE 1.1. Centralized Estimation Architecture 


A 
x 
CCORDINATOR 
OR 


GLOBAL ESTIMATOR 









PROCESS ENVIRONMENT WITH STATE x 


FIGURE !.2. Hierarchical Estimation Architecture 
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[{. HORIZONTAL ESTIMATION ARCHITECTURE 


A. MAIN FEATURES OF HEA 

The main concept of distributed estimation applied to DSN is used. 
Specifically, each node in the network performs local processing of the data 
collected only by its own sensor or sensors. The locally processed data from 
each node are communicated through an appropriate data link to its 
neighboring nodes (where possible), in addition to using it locally. Thus 


providing a mesh network topology ( Figure 2.1). 


O = Network Node 
—— = Communication Link 


FIGURE 2.1. Mesh Network Topology 
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B. GRAPH REPRESENT ATION OF A MESH NETWORK 

Using graph theory with some modifications, we represent the mesh 
network as a directed graph G [Ref. 7:pp. 424-473]. 

Definition: Let V be a finite set. A mesh network can be represented as a 
directed graph (or digraph) G on V, made up of the elements of V, called the 
nodes of G, and a subset E of the cross product V xX V, called the 
communication links of G. If a,b € V and (a,b) € E, then there is a 
communication link from ato 6. Node a is called source of the link, with b 
the terminus, or terminating node, and we say that b is neighbor to a, and a 
is neighbor to b. It is asumed that G is loop free, and there are no isolated 
nodes. Generally each node is a source and terminus. 

Based on that definition, let V be the set of nodes, while E is the set of 
communication links, and it is a subset of the cross product of the sets V and 
VG 

EC(VxY) | ae 
where VY xV-={(a,b,¢, .......n) | a,b,c,....n €V) (2.2) 
and we write the mesh network G as 

CS, (2.3} 

where G, usually is not fully connected, t.e. for all x.y € V,z # y, there ts not 
necessary a link from x toy. In mesh networks, a link 1s often directed in 
both directions (bidirectional). Consequently, if G is a directed graph and a,b 
€V,a#, with both (a,b) , (b.a) € 8, the undirected link in Figure 2.2(b), are 
used to represent the bidirectional link shown in Figure 2.2(a). In this case, 


a and b are called neighboring nodes, and it is represented as 
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({a,b]} = ((a,b),(b,a)}. In HEA the data processing capacity can vary from node 


to node, and communication capacity can vary from link to link. 


/ 
/ 
Oo 
a a 
(a) (D) 


Figure 2.2, Representation of a Bidirectional Link 
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V ={(a,b,c,d,e,f } 
E = ( [a,b], {a,el, {a,f], {b,f], fe,f], (b,c), (4,0), [d,e] } 
G = (VE) 


Figure 2.3. Mesh Network Representation Using 
Directed Graphs 
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Example: The mesh network shown in Figure 2.3, is represented as 
G=(V,E) 
where V={ab.cdef } 
and V x V={{ab.cdef)|abcdef eV} 
and EC(Vx/Y) 
E = { [a,b], fa.el, [af], [bf]. lef]. (b,c), (d,c), [del } 
It is clear that (b.c) indicate a unidirectionai link from b toc, and [a,b] 


indicate a bidirectional link between a and b. 


C. PROPOSED DSN INTELLECTUAL ASSETS 

In the literature, data and information are used interchangeably. 
Actually, data and information are not synonymous. There is a distinction 
between them. Data become information only when they are useful and 
available. This means that information is produced as output of data 
processing operations and used to enhance understanding and to achieve 
specific purposes [Ref. 8]. Figure 2.4, shows a pictorial view of , proposed 
DSN intellectual assets shown as a four laver pyramid. The bottom layer 1s 
the data collected by sensors, which are processed using a data processing 
mechanism. The results of the data processing are information. which is the 
second layer, and it is Aoparentty the processed data. The information added 
to the expertise of a human expert, resulting in knowledge, which 1s the 
third layer. The knowledge is used for developing the knowledge-base, 
which is the core of the expert system. The expert system is used for aiding 
the controller-decisionmaker in giving intelligent decisions, which 1s the 


utmost purpose of the DSN. It is noted that the human expert is kept in the 
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loop from time to time to adapt the knowledge-base to cope with the 
changes in any situation affecting the environment sensed by the sensors. 

Based on that, the result of processing data at each node taken by its own 
sensor or sensors is local information, which is tied or fused with the 
incoming information from neighboring nodes to obtain an updated situation 
assesment at each node anc forming a coherent picture that resembles as 
Closely as possibile what is happening in the local area of interest. 
Consequently, ve have termed the bringing together of locally processed 
data from different neighboring nodes into a coherent picture “ information 
fusion’. | 

In fact, by information fusion we also mean to include all sources of 
information, not just that from processing electromagnetic, acoustic, optical 
and infrared sensors data. There are for example in defense systems, human 
observers providing intelligence information and a background of 
encyclopaedic information and operational! plans (Ref. 9]. Also, fusing local 
information and incoming information from neighboring nodes can be done 
only after deciding that they are originated only from the same origin. So, 


the fusion process implies a decision process. 
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Figure 2.4. Pictorial View of a Proposed 
DSN Intellectual Assets 
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D. INFORMATION ELEMENTS OVERLAPPING IN HEA 

The principle of inclusion and exclusion is adopted with slight 
modifications to represent the information overlapping of different nodes in 
HEA [Ref. 7:00. 190-213]. Let S be a set with N=!SI, where 'Si is the 
cardinality or size of S, ie. denotes the number of elements of 5 fin MMT 
case it can be the number of tracks). Let cy, C9, .....c, be a collection of 
conditions or properties satisfied by some, or all, of the elements of S. Some 
elements of S may satisfy more than one of the conditions (e.g. range and 


bearing in MMT case), while some may not satisfy any of them. For 1 =i St, 


N(c;) will denote the number of elements in S that satisfy condition c, For i, j 
SO ce th iA, N(cjc) will dencte the number of elements in 5 that 
satisfy both of the conditions c,,c;, N(cjc,) does not count the elements of S 
that satisty only one of the conditions c; and c;. If 1 31,j,k =t are three 
distinct integers, then N(cjc.c,) denotes the number of elements in S 
satisfying each of the conditions cj, c; and cy (e.g. range, bearing and velocity 
in MMT case). For | $i St, N(c,) denotes the number of elements in S that 
do not satisfy condition c;. In this case, N(c;) = N- N(c;). If 1 Si. j St, ij, 
N(c,¢;) - the number of elements in S that do not satisfy both of the 


conditions c; and ¢;. 
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FIGURE 2.5. Two Information Elements Inclusion and Exclusion 


From the Venn diagram in Figure 2.5, it is seen that if N(c;) denotes the 
number of elements in the left-hand circle and N(c,) denotes the nu mber of 
elements in the right-hand circle, then N(cj;c;) is the number of elements in 
the overlap, while N(cjc;) counts the elements outside the union of these 
circles. Consequenily, N(c;¢,) = N - [N(c;) + N(c;)] + N(cjc,), where the last term 
is added on since it was eliminated twice in the term [N(c,) + N(c)]. In like 
manner, from Figure 2.6, 

N(cicc,) = N - [N(c;) + N(c;) + N(cy)] + [N(cjc,) + N(cicg) + N(cjcy)] - Nf cjcjcy) 
Generaily, the number of elements of S that satisfy none of the conditions c., 


met =i, is 


N(c¢,¢3 oe C,) =N- [N(c;) £ N(c) Ls N(c3) Fe eater net = N(c,)] 


ZY 


- [N(cycac3) + NicyCacg) + + N(cyeae,) + N(cyc3c5) + + 
+ N(Cy C3 Cp) + vee +N( Cy 90g Cp) + oo + (- DEN (Cy 0305 Cy), 


OC 
N(cyCocy veers: Cy) =N- > Nc) ~ >» Nle,)) - > Nleseicy) pees: 


Icict Icichct beret 


+(-])e N(c4C3C4 eceeeg C,) (23a 





FIGURE 2.6. Three Information Elements Inclusion and Exclusion 


Now, assuming the number of elements in S that satisfy exactly m of thet 
conditions is ¢, where | 2m $1, then 
e;> N(cjC2C3 ioe cH ji N(C, CC; ae ea) ie bs + N(c)C2¢3 noes Co (2.5) 


and 


28 


€9= N(c1C9C3 rae cw = N(c,C9¢3 iss Cy) aeons - N(c,C2C3 ences Geocec) (2.6) 





a= 3) 


FIGURE 2.7. Information Elements Inclusion for t=3 


Using these results as a starting place, as Figure 2.7 is examined, where 


t=3, a numbered condition is placed beside the circle representing those 


elements of 5 satisfying that particular condition. Then e, equais the 


number of elements in region 2, 3, 4. But it can be written that 


e, = N(c,) + N(co) + N(c3) - 2EN(cyco) + N(cyc3) + N(cge3)} + 3N(cycgc3) = (2.7) 


In N(c,} + N(c>) + N(cz) the elements in regions 5, 5, and 7 are counted twice 


and those in region 8 are counted three times. In the next term the 


elements in regions 5, 6, and 7 are deleted twice. The elements in region 8 


a 


are removed six times in 2[N(cyc2) + N(c,c3) + N(c2c3)], so the term 3N(c,c3¢3) 
is added and end up not counting the elements in region 8 at all. Hence, 
e, = Sy - 282 + 383 = S; - (7)S2+(5)s; (2.8) 
For e,, the earlier equation indicates that it is needed to count the 
elements of S$ in regions 5, 6, and 7. From the Venn diagram 


@> = N(cycy} ~ Nicyc3) + N(czc3) - 3N(cyc¢3) 


= $2 - 383=S$2-(7)S, (2.9) 
and 
e; = N(cyc2c3) = S3 (Zion 
Generally, for any | =m St, the number of elements in S that satisfy exactly 
m of the conditions C,, Co, Cz C, 1s given Dy 
Om = Sm Sey + (ES g oe + (DEM, FS, (2.11) 


E. COMMUNICATIONS BETWEEN DIFFERENT NODES 
To enable communications between different nodes (processors) the 
following items must be considered [Ref. 10]: 


!. The electrical and physical characteristics of the medium chosen for 
the interconnection. 


Z. The signalling used to ensure the reliable transmission and reception 
of data. 


3. The means of effecting flow control in order to align the rate of data 
exchange with the processing capabilities of the machines. 


Actually, when two information nodes communicate across a network, a 
network access orotocoi between each node and network is needed. The 
requirements for such a protocol differ significantly for a communication 
networking technique to another. By protocols, we mean the set of rules, 


procedures and conventions by which information is transported through the 
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computer communications network. The key elements of a protocol are [Ref. 
ie 
1. Syntax: includes such things as information format and signal levels. 


2. Semantics: includes control information for coordination and error 
handling. 


3. Timing: includes speed matching and sequencing. 


F, MAIN COMPONENTS OF HEA 

Based on the previously mentioned distributed estimation approach, 
Figure 2.8, shows a pictorial generic view of the main components of the 
Horizontal Estimation Architecture (HEA). By architecture we mean the set 
of algorithms, rules, conventions and protocols that implement the horizontal 
estimation functions and their interrelationships. The introduced HEA has 
four major components, the local estimator, the information fusion process 
(both together are called Horizontal Estimator), the network access protocols, 
and the controiler-decisionmaker. 

The control policy used is decentralised, with control decisions made 
independently by each node using the estimates of the states resulting from 
the infor mation fusion process. The expected value of a quadratic 
performance index is minimized to assure maximum system robustness. 
That is, gradual or partial system failures would have minimum degradation 
in the performance. Also, it avoids the development of complex strategies 


which are difficuit and costly to achieve and implement. 
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FIGURE 2.9. Distributed Sensors Network (DSN) 
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G. PROPOSED FUNCTIONAL ELEMENTS OF A DSN 

Based on the HEA, we view the DSN to be represented as shown in Figure 
2.9, by five basic functional elements : the environment, sensors, the 
horizontal estimator, data communications network, and controller - 
decisionmaker. 

Each sensor complex, horizontal estimator, and controller-decisionmaker 
18 sited in a node, which we call an “information node to differentiate tt 
from a communication node. Throughout the seque!, node 1s used to indicate 
the information node. Each information node is connected through a 
communications node and an appropriate data link to ils nearest neighboring 
nodes, thus providing a mesh network topology. As mentioned defore, each 
information node performs processing functions by local estimator using the 
local sensor|sensors) data, communicating the processing results to other 
neighboring nodes, in addition to using it locally. The information fusion 
process fuses the information received from neighboring nodes with the loca! 
information. The HEA can be f urther extended to cover a verv large scale 
DSN tn the case when each node can be the central processor of a centralised 
network, and, or a global estimator (parent node) of a hierarchical network 


‘Figure 2.101 


H. MOTIVATIONS TO HEA 

In HEA, the approach of “divide and conquer” which ts useful for most 
complex problems can be easily used. Partitioning allows any large complex 
system to be divided into manageable portions. Another motivation to the 
HEA is that network splitting and reformation or connection of additional! 


compatible networks are practicable during system operation and do not 
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Cause any restriction as a new system is initiated. Additional advantages of 
this design approach are, usage of microcomputer systems, which provide a 
cost-effective solution for data processing, reliability, survivability, loca! 
autonomy, heterogeneous feature, low cost communications and its 
practicability for already existing information nodes, which need to be tied 
together. The partitioning approach used in HEA allows large complex 


systems to be divided into manageable croportions. 
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ITT. OVERVIEW OF TRACK-WHILE-SCAN SYSTEMS 


A. TWS RADAR SYSTEM CONCEPT 

The process of tracking targets based on discrete radar information 
obtained while the radar continues to scan the airspace is referred to as the 
Track-While-Scan (TWS) processiRef. 12], and is accomplished in a digital 
computer in modern day surveillance radars. For a TWS system, search and 
track update functions are simultaneously performed. In TWS. a single 
sensor scanning at a constant rate illuminates new targets and targets 
already in track files at the same time. Also, only those target tracks that 
remain within the TWS search volume can be maintained. In an automatic 
TWS air-surveillance system, the radar sensor reports measurements of 
target observations at regular intervals of time to a computer, which then 
assembles the observations from successive scans into tracks. The computer 
software must correctly associate new plots with the existing tracks and 
initiate new tracks from reports received on air targets within range of the 
cadar. The association task is aided by tracking filters which combine noisv 
measurements with track predictions to obtain smoothed updated track 
estimates. [The predicted position of the target for the next radar scan, based 
on the smoothed estimate of the current position of the target, is used 
together with the estimated standard deviation of the orediction to 
determine the location and size of the region of acceptability of new 
observations on the target. The tracking filter thus plays an essential role in 


the function of plot- to- track association, in addition to its role of providing 
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accurate estimates of the position and motion of the target. In TWS only 
position and velocity states are estimated because with low update rates 

( like every 4 seconds), the noisy acceleration estimates would not contribute 
very much. Typically, in intercept problems, the missile requires only line of 
Sight rates for deployment. 

For the TWS system, both search and track update are done 
simultaneousiy. At the end of the scan interval, all observations received 
during the scan are correiated with the existing tracks. An operational air- 
surveillance system must be capable of tracking many targets 
simultaneously in an environment that may provide large numbers of false 
target indications due to reai and artificial clutter as well as system noise. 
The measurement accuracy obtained and the tracking precision of such 
systems may not demand the most computationally complex filtering 
operations. I[t is essential that the filtering operations give sufficient support 
to the association procedures; any complexity beyond that and not necessary 
for this task is of diminishing value. It is important however that the filter 
be sufficiently flexible to adjust quickly to changes in the tracking 
environment. The literature on the techniques of track filtering is very large 
and diverse. [t is important to use simpie, easily implemented, and 
computationally inexpensive filters which nevertheless retain as far as 
possible the features of optimality and flexibility which the most general and 
expensive forms embody. 

By automating the target detection and tracking process (Automatic 
Detection and Tracking) which is called ADT, the bandwidth in the output of 


a radar is reduced so as to allow the radar data to be transmitted to another 
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location via narrowband communication links rather than wideband 
communication links [Ref. 12,13]. This permits the outputs of many radars 


to be intercommunicated economically. 


B. TWS RADAR FUNCTIONS 

The signal processor determines the presence or absence of targets while 
rejecting unwanted signals due io ground clutter, sea clutter, weather, radio- 
frequency interference, noise sources and intentionai jammers. It is 
performed by coherent and/or non-conherent processing of time samples of 
the received signals [Ref. 13]. The signal processor is implemented in real- 
time special purpose hardware. Basic operations that-ure now routinely 
exploited as a result of the advances in digital technology [Ref. 14], include: 

1. Pulse Compression (PC) 

. Pulse Doppler Processing (PDP) 
. Moving Target Indicator (MTI) 
. Moving Target Detector (MTD) 


LA ok OG OD 


. Constant False Alarm Rate (CFAR) circuit 
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in Modern TWS Radar Receiving Phase 
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The data extractor provides the target measurements in range, angles 
(azimuth, elevation), radial velocity and possibly provides target signature. 
In general, a target may cause several detections in adjacent cells in range, 
Doppler frequency and angies. The centroid of the corresponding pattern of 
detections gives an estimate of the target measurements. The data extractor 
is generally implemented with a dedicated microcomputer. 

The data processing is performed on a digital computer inserted between 
the piot extractor and immediately before the display. It can be defined as 
the set of algorithms which, when applied to the radar detections acquired 
during successive scans, allows the following: 


1. Recognition of a pattern of successive detections as pertaining to the 
Same target. 


2. Estimation of the kinematic parameters (position, velocity, and 
acceleration) of a target, thus establishing a so-called ” target track ”. 


3. Extrapolation of the track parameters. 


4. Distinguishing of different targets and thus establishing a different 
track for each target. 


5. Distinguishing of false detections (caused by intentional or natural 
interference) from true targets. 


6. Adaptive refinement of the threshold setting of the signal processor 
in order to make the radar more or less sensitive in the different 
Spatial directions, depending on the content of a map of false 
detections refreshed on a scan-to-scan base. 


As shown in Figure 3.1, it is important to emphasize that the cascade of 
signal processor, data extractor, and data processor is ultimately a 
bandwidth compressor. [t receives data at a high rate and processes the 
signal in such a manner that a relatively low data rate is achieved. This 


feature is pictorially indicated by the narrowing of the arrows moving from 
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the left to the right of the cascaded processors. At the same time, there is a 
progressive discrimination between useful and clutter data, by means of a 
stepwise decision process. The information handled by the processing chain 
is progressively manipulated into a form which allows easier decision 
making by the user. In fact, the raw video signal contains many false 
echoes. The data extractor isolates the useful target and the data processor 
identifies the target ( possibly labelled with a code), determines the target 
velocity and additional parameters which are presented in a tabular display. 
A further observation can be made regarding the increase of the time span 
in which processing is performed through the cascade. The signal processor 
invoives only a few pulses, the data extractor some adjacent grouos of pulses 
and the data processor consecutive radar scans. In other words, the memory 
of the processing increases on moving from left to right in Figure 3.1. 

So, these TWS systems are excellent candidates for the application of HEA, 
since they are already have their local estimation processors which perform 
the functions of track initiation, plot-track correlation, track prediction, track 


filtering, and track termination. 


C. RADAR OUTPUT 

The output cof aT WS radar is generaily a display to visualise the 
infor mation contained in the radar echo signal in a form suitable for operator 
interpretation and action. The visualised information on the disolavy ts called 
“ synthetic video” in contrast to the so called " raw video’ whicn’ is the 
information shown when the display is connected directly to the video 
output of the receiver [Ref. 14,15]. Synthetic displays, whilst being a 


processed representation of the signals which are being received by the 
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radar sensors, have the advantage that all responses, irrespective of the 
weakness of the returned signal, can be displayed at a constant level! of 
brilliance and clarity. The Plan Position Indicator (PPI), the usual display 
employed in radar, indicates range and azimuth of a detected target. The 
idea of tracking is easily Visualized if successive scans containing a moving 
target are superimposed, the target then gives rise to a fairly regularly 
Spaced sequence of returns. 

In the past, an operator manually marked the location of the target at 
each scan with a grease pencil on the face of PPI. This procedure was very 
simple but offered poor accuracy and simultaneous processing of onlv a few 
targets, due to operatcr fatigue. The Jimitations of the operator have been 
overcome by resorting to a computer which automatically performs the 
whole tracking process. This computer has been referred to as the ° data 
processor in Figure 3.1. In order to design an automatic procedure to track 
one or more targets, it is convenient to examine the nature of the pilot 
sequence provided by IWS radar. The better the expected properties of the 
sequence can be defined, the greater is the ability of the tracker to 
distinguish among different targets and false plots. False plots are caused by 
Clutter, intentional interference and noise which survives the action of signal 
processing. The spacing of the consecutive target pilots is caused by the 
target velocity which may vary in time as the target executes various 
maneuvers. In the case where the target is an aircraft, upper and lower 
limits can be placed on the magnitude of the velocity. Further, an upper 
limit on the magnitude of the acceleration of the aircraft usefully restricts 


the possible tracks the aircraft can make. 
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D. CLASSES OF TRACKS 
In a modern TWS system, a set of computer software establishes and 
maintains a number of files pertaining to three different classes: 


1. Firm tracks; a firm track occurs when the path of a target has been 
acquired by the data processor and the kinematic parameters 
estimated with sufficient accuracy. 


2. Tentative tracks; a tentative track corresponds to the first phase of 
the track acquisition of target or clutter plots. 


3. Stationary tracks; a stationary track pertains to clutter, since its 
position does not significantly change from scan to scan. 


The files are produced by processing the plots received from the radar on 
a scan-to-scan basis and stored in a buffer as, as outlined in Figure 3.2. The 
contents of the output buffers are periodically updated and displayed to the 
operator. A firm track occurs when the path of a target has been aquired by 
the data processor and the kinematic parameters estimated with sufficient 
accuracy. By contrast, a tentative track corresponds to the first phase of the 
track acquisition of target or clutter plots. Finally, a stationary track 
pertains to clutter, since its position does not significantly change from scan 
to scan. The tracks have been divided into different classes because their 


corresponding orecessing and utilization differ. 
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FIGURE 3.2. Track Classes in TWS Systems 
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E. THE CLUTTER MAP 

Because an operational environment may be affected by a large number 
of false target indications caused by fixed and moving clutter as well as 
system noise, a particular attention must be paid to filtering out these 
disturbances. This is carried out by the formation and updating of a clutter 
map, which identifies spurious plots from the input buffer so that the 
remaining plots pertain only to valid targets. The use of the clutter mao 
produces some benefits to a radar operating tn a clutter environment: 


1. It allows proper selection of signal-processor operating modes ( e.g. 
the MTI 1s switched on only where it is needed, thus avoiding 
unnecessary detection oerformance degradation itn a clear 
environment, the thresholds of the detection logic are controlled 
according to the residual clutter power). 


2. It allows removal of clutter points from the radar plot buffer, thus 
preventing saturation of the processing and the formation of spurious 
tracks which reduce confidence in the track data. The clutter map 
updating process is also referred to as a Stationary Track Filter (STF) or 
Scan to Scan Correlator (SSC), [Ref. 17]. 


The STF acts as a velocity discriminator upon the plot stream coming 
from the data extractor. Plots which appear to be stationary or slowly 
moving from scan to scan are stored in the clutter map. Each new incoming 
plot is compared with the content of the map, if the plot falls within a 
defined capture area around one of the clutter map entries, then the new 
plot is deemed to be clutter. As a consequence , it updates the clutter map 
content and is deleted from the radar plot buffer. STF can also be considered 
as a device capable of forming cancellation masks centered around targets 


(true or spurious) with a velocity below an established threshold value. 
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The velocity discrimination is performed by comparing the plot 
displacement in two or more of the subsequent scans with respect to a gate 
centred around the first position (already measured) of the clutter map 
entry. [tis obvious that, for clutter points or slow-moving targets, the 
subsequent echoes remain in the gate for a large number of scans, but for 
fast targets, the echoes are in the gate for only few scans. By computation of 
the scans required by the target to leave the gate, it is possible to determine 


its velocity. 


F. OPERATIONAL REQUIREMENTS 

The operational requirements for data processing vary with the type of 
application. Typical requirements are estimation accuracy, extrapolation 
time and system reliability (Ref. 17]. In maritime collision-avoidance 
systems it is necessary to detect potential collisions well in advance (15-30 
minutes) because of long reaction times, especially for large ships such as oil 
tankers. The estimation error on the forecast position must be lower than 
one nautical mile. Therefore the accuracy by which the velocity is estimated 
must be within | knot. This requirement determines the degree of filtering 
to be applied taking into account the measurement error and the data rate of 
the radar. 

In the case of ATC, the radar information may support the function of 
tactical control, conflict alert and approach control. In tactical control, the 
radar controller checxs the current positions of the aircraft to maintain the 
standard separations. Whenever the separations tend to be violated, the 
cadar controller advises the pilots involved about the local trajectory 


modifications required to re-establish acceptable conditions. In conflict 
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alert, the processing system estimates the forecast positions of all the 
aircraft to determine the conflicting pairs of aircraft; the extrapolation time 
is from | to 2 minutes. The processing system can also evaluate the 
trajectory modifications for one or both aircraft to resolve the conflict 
Situation. [In this case, one nautical mile may also be assumed as an 
acceptable accuracy in the estimation of forecast position. Of course, possible 
maneuvers during the extrapolation time may be taken into account in the 
evaluation of the conflict area. Therefore, where two aircraft are conflict 
free when flying straight and could be taken into conflict if one or both 
maneuver, an order may be given to both aircraft to keep the straight 
trajectory constant. In approaca control, the controller checks that aircraft 
follow fixed paths to assure a safe landing. A higher accuracy than the 
preceding one is required here, i.e. a fraction of one nautical mile. 
In an air-defence system, the estimated trajectory is generally used to 

help perform some of the following functions: 

a. threat identification 

b. threat evaluation 

c. calculation of the forecast position (for fire or launch of missile) 

d. weapon assignment 

e. kill evaluation 
The functions a to e do not necessarily use the measurements of one single 
radar. For exampie the fire controi function ¢ is generally performed by a 
tracking radar with the characteristics of good accuracy and high data rate. 

It may be noted that in ATC, all the trajectories are easy to follow 


because of path regularity, low acceleration (2-3 m/s*) and pilot 
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collaboration; whereas, in air defence, targets have high accelerations (10-50 
m/s*) and manoeuvres that are intentionally evasive. Furthermore, it is 
important to have a very short reaction time, especially for targets detected 
at short range such as low-flying aircraft and sea -skimmer missiles. 
Generally, the data processing from a radar extractor is more difficult for 
air-defence systems than that for civil-traffic control, because the target 
acceleration is high and unpredictable. In addition, jammers interfere with 
the proper working of the system. The effects of these phenomena are 
reduced by radar signal processing using particular devices, such as moving- 


target detector and multisidelobe canceller, which limit the false detections. 


G. NETTED RADAR SYSTEMS 
Much recent interest has centered around radar netting. Estimation of 
location, velocity and maneuver together with possible identification of each 
relevant target can be provided by Radar Data Processing (RDP) with an 
accuracy and reliability greater than that available from a single fook radar 
report. Today, it is also very important to net different types of sensors in 
addition to radars in order to enhance performance. The current various 
types of radar networks can be classified according to the leve! at which the 
merging of data is taking piace into the two following classes: 
1. centralized 
2. distributed 
The centralized architecture (see Figure 3.3) is characterised by the use of 
a single data processor to which radar plots are transmitted from radar sites. 
These measurements are processed so as to obtain a single multiradar track 


for each target. This architecture has the features of : 
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a. using tracking algorithms with variable data rate. 


b. reducing tracking errors because of the higher data rate than with a 
single radar. 


c. requiring more powerful processing resources. 


d. being the prevaient type in military applications owing to the higher 
accuracy gained. 


The distributed architecture (see Figure 3.4) is characterised bv the use of 

a computer at each site oerforming the tracking function on the 
measurements of a single radar. The monoradar tracks instead of radar 
plots are then transmitted to a single data-processing centre which combines 
them in order to establish a single multiradar track for each target. The 
following features are relevant for this architecture: 

- jit is capable of iocal operation. 

- jt requires computing resources of limited power. 

- jt mainly requires monoradar processing algorithms. 


- jt prevails in ATC because of simplicity, reliability and growth capability. 
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FIGURE 3.4. Distributed Architecture of a Radar Network 
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The proposed HEA as a distributed architecture applied for radar netting 
would be convenient and cost effective to be used specially for modern TWS 
radars which have their local tracking systems already installed and it 
guarantees the maximum utilization of the local resources of each radar site 
and taking advantage of the advanced techniques taking place in each major 
block of the radar systems (Figure 3.5). The problem of the lack of 
experienced decision makers whica !ead to the centralization of decision 
making can be soived by the use of expert systems and encapsulate the 


decision maker expertise in computer software. 


53 








- LARGE BANDWIDTH 
- POLARIZATION CONTROL 
TRANSMITTER m6 ANTENNA - DIGITAL BEAMFCRMING 
- ULTRA-LOW SIDELOBES 
1 - SPACE ADAPTIVITY 
T~ SoLID STATE | “ADAPT 
~ FREQUENCY AGILITY - MULTI-DIMENSIONAL 
- FREQUENCY DIVERSITY RECEIVER FILTERING 
~ HIGH DUTY SIGNAL - LARGE BANDWIDTH 
- WIDE CLASS OF CODED PROCESSOR = MUL Th aQnb ste 
WAVEFORMS OPERATION 
- HIGH DYNAMIC RANGE 
-VHSIC 
RADAR DATA - pe POSITICN 
CONTROLLER oe - CLASSIFICATION 
-VHSIC 
- TRACKING ALGORITHMS 
FOR HIGHLY MANEUVERA 
——— - MASS RAID TRACKING 
- MANAGEMENT OF RADAR PROCESSOR - FILTERING OF FALSE TRACK 
RESOURCES AND DEGGOSTING 
- EMISSION CONTROL -VLSI/VHSIC 
- SCHEDULE OF RADAR 
ACTIVITIES 
ARTIFICIAL INTELLIGENCE ee 
DISPLAY - EXECUTIVE ALGORITHMS 
- ARTIFICIAL INTELLIGENCE 


PIGURE 3.5. Advanced Techniques in the 
Main Blocks of a Radar System 
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IV. HEA APPLICATION TO MMT’ PROBLEMS 


A. OVERLAPPING COVERAGE OF A RADAR NETWORK 

The HEA is applied to the Multitarget Multisensor Tracking (MMT) 
problems in a tactical air surveillance system. The problem is to produce a 
Statistically meaningful estimate of both the number of the targets present. 
and of their trajectories. It is assumed that the system employs Irack- 
Whiie-Scan (TWS) radars with different scan rates and with overlapped 


coverage. [he degree of overlap of the radar coverage ts defined is as 
| N 
ee ea as (4.1) 
a j tot 
J=- 


Where A is the area covered by the is radar 


A tot is the total surveillance area controlled by the radar 


N ts the number of radar sites(nodes) 
The parameter €& ranges from | (absence of overlap) to N (total overlap). 
Figure 4.1, shows an example of overlapping coverages between three 
radars, R, , R. R.. If the degree of overlap is very small, the advantages of 
the data redundancy are limited,on average, to small areas and few targets. 
Assuming that the targets are evenly distributed in A with density 5, then tt 


follows from equation { 4.! ) that 


. , 
& = >| no/ Deo (4.2) 
a= 
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N 
6- 2a / ay (4.3) 
j=! 
Where A is the number of targets in the area A 


ies is the number of targets in the total area A 





FIGURE 4.1. Example of Overlapping Coverage Between 
3 Radars in a Network 


Generally, the most obvious exploitation of additional radar sites is to 


extend the coverage beyond the maximum range of a single radar, as 


established either by line of sight or by radar power. Also, the viewing of a 


target from different aspects angles tends io reduce target fades, glint and 


terrain masking effects. It is assumed that radar sites will De primariiy 


chosen with the aim of optimal radar coverage of the entire network. We 


consider the multitarget and multisensor problems separately, and then 


merge the two. This means that the multitarget tracking problem is solved 
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at the sensor (node) level using the appropriate local estimation algorithm. 
When the multitarget tracking problem is solved separately for each 
individual node, a somewhat redundant view of the surveillance area will 
result, depending on the degree of overlapping coverages between the 
radars. The output of the local estimator is a group of different tracks. A 
track, is meant to be a state trajectory estimated from a set of sensor 
measurements that have been associated with the same target [Ref. 18]. By 
assuming that the multitarget tracking problem ts solved separately for each 
individual sensor (node), the track estimates for targets in the surveillance 
area become consolidated first at the level of each individual node. The 
information fusion process decides whether more than one track from 
different nodes represent the same target, and combines the corresponding 
consistent tracks. The techniques for information fusion can be based on 
algorithmic processing of target Kinematic information and heuristic 
reasoning for attribute inf or mation by using expert systems to encapsulate 
target identity, behaviour, intent, tactical appreciation and human expertise 


in computer software. 


B. DISCRETIZATION OF A SYSTEM DYNAMICS MODEL | 

The mathematicai mode! of a target motion, as state equation, is derived 
when assuming that the target normally moves at constant velocity, and 
turns or evasive maneuvers may be considered as perturbations upon the 
straight lines. Therefore acceleration is a driving input for the state 
equation which is usually linear. A simple way to mode! the unpredictable 
behaviour of acceleration is to consider a non-Gaussian stochastic stationary 


process (symmetric with zero mean and proper standard deviation) with a 
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correlation depending on the time duration of manoeuvre [Ref. 18]. When 
an aircraft flies, it normally maintains a constant velocity, constant heading 
trajectory. Consequently, the system dynamics model is given by the 
following continuous time state equation 

x(t) =A x(t) + G wit) (4.4) 
Where w(t) is the random forcing function ( continuous time white process 
noise), w(t) ~{ 0,0 ). We wish to put the continuous equation (4.4) into the 
discrete iorm 

x (k+1) = x(k) + wk) (4.5) 


Where w(t) is the contribution from the random forcing function. The 
generai solution of (4.4) for x(t) given the value x({ {,) at initial time ¢, is 


t. 
x(t) = S(t,t,) x(t) + Jo (t,7) G7) w(7) aT (4.6) 


ty 


Defining T to be the sampling interval, to describe the state propagation 
between states, jet t = (kr 1)T , Las KT for an integer k and assuming 


stationarity, so that: 


DN ae AG = $(T) (4.7) 
Defining the sampied state function as x(k) = x(KT ) we can write 
(k+I}T 
X(k+1) = @(T) x(k) + J ((k+1) T-7) G w(T) dT (4.8) 
KT 


The second term in the rignt hand side is a low pass filtered version of the 
continuous White process noise w(t) weighted by the state transition matrix 


and the noise input matrix G. 
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On changing variable twice ( & = T-kT and then Also, T=T - &), the limits 
of integration can be set to 0 and T, so that, as a first step in the discrete 
formulation of (4.4), we obtain 
T 
x(k+1) = @(T) xk) + [6(1) G6 w(t) at (4.9) 
0 


Again under the assumption of stationarity, the transition matrix can be 
expressed in terms of the matrix exponential. Then, an expansion can be 


performed to give an approximate solution: 
BUT e | = pelle? ( AT )2 12.4 ecercccscssn + AT )°/nl (4.10) 


Where | is the identity matrix. If terms of order T“ and higher are 
disregarded, then the result is Euler's approximation to the sampled svstem. 


Equation (4.9) becomes 


@(7T)= 1+AT (4.11) 
and the discrete - time process noise w(K) relates to the continuous time one 
as follows 
T 
w(k) = seine w(T) aT (4.12) 
0 


To find the covariance Q (k) of the new noise sequence w(K) in terms of Q, 


we write 
Q (k) = E { w(k) w! (k) 
(k+1)T 
Q (k) = J fe(k+1)T-7) 6 E{w(t) w (oc) G @ ((k+1)T-o) dtdo (4.13) 
KT 


D9 


But E [w(7) w'(o)] -Q & T- 0) 
So 


(k+1)T 
Q(k)= [e({k+)T-1)G0G6) O ((k+I)T- 7) at (4.14) 


oT 
by changing variables twice as before 


; 
Q(k)= fenGaG (1) at (4.15) 
O 


It is worth noting that even if Q is diagonal, Q (k) need not be. Sampling can 
destroy independence among the components of the process noise. Using 
(4.10) then 

Q(k)=GOG T+(AGQG + GQGA )TZ/ 2) tenn (4.16) 
In Euler's approximation the process noise covariance Q (k) results from 
multiplication by T. 

Q(k)-GQ6'T 

Figure 4.2, shows the sequence of operations used to evolve the discretized 


equation of an aircraft. 
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system State Equation 


x(t) = A x(t) + G w(t) 


Driving Terms 


T 
95 2G Ww dT= Wik) 


Discretized System 
Dynamics Modei 


x(k+1) = ®& x(k) + wk) 





FIGURE 4.2. Evoiving of the Discretized System 
Dynamic Model 
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C. MMT MATHEMATICAL MODEL 
Suppose that s targets are present, and the discretized equations of 
motion for each target being tracked is adequately modeled by a separate 


stochastic difference equations of the form 
x (k+l) = @ (k+1,k) x (k) + w (k) K-01 (2 (4.17) 


The superscript indices i denote the various targets. x (kK) is the nx! state 
vector (which generally inciudes at least position and velocity coordinates) of 
the tracked target at the kth sample time. @ (.,.) is the (nxn) state transition 
matrix, and Ww (k) is a pi x1 state excitation vector, which is usually 
constructed in aircraft tracking applications to account for both maneuvers 


and modeling errors, and is generally assumed to be white and gaussian, 


with zero mean and covariance Q' (k). In a TWS system, the k"" sample will 


occur approximately at time tee where T” is the scan time of the jth sensor 


The corresponding discrete measurement vector from each node Its given by 


z°(k) = ho (x! (k),k) + v4 (k) {= | ea (4.18) 
Where the superscript } indicates the various nodes. 2°(k) is a q” xX] 
dimensional measurement vector at node j at stage k. h’(.,.) is the 
observation equation for j'® sensor, v’{k) is assumed to be white and 
Gaussian, with zero mean and covariance R’(k). It is further assumed that 
w (k) and v’(k) are not serially or cross-dependent, in particular 

g{w(k)v°(2)]+=0 forall & and £ (4.19) 

In the s-target case, each individual measurement z’(k) of an actual target 
at time kK ts drawn from a mixture probability density of the form 


> 
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D(Z?(K) 1X" (K),X" (K)yeonea® (K)) = DB, p(Z2(K) 1 X'(K)) (4.20) 
I=] 
with unknown priors denoted p. 


Denoting the number of measurements at time kK by m(k), a set of mth) 


’ k=} 
measurements ts 


mk) on 
| 


=z (Ke) he? ON (4.21) 
L ie Ket 


Where 7° is the cumulative set of measurements at each node. 


It is the essence of multitarget tracking problems that there ts a large 


amount of overiap among the component densities of (4.20), so that the 


target-io-measurement correspondece x (k) <= 2°(k) is difficult to obtain. 


The set of all measurements 7’ can be partitioned into m tracks 


i a 
Zi=r UN UD Urceeees Up 
where NAAN =0 for 14] 


One of the tracks (e.g d”) contains all of the false alarms. With this notation, 
any hypothesis concerning measurements made by the surveillance system ( 
the number of targets present, which data points belong to which target) can 
be defined as a family of subset 

(ET 
The defining characteristic of multitarget tracking probiem is that a number 
of partitions can be found, each one composed of tracks * that appear 


feasible from the standpoint of the likelihood tests. 
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D. THE HORIZONTAL ESTIMATOR 

Figure 4.3, shows the processing of target data using the Horizontal 
Estimator (HE) at each node. By using tracking filters such as those discussed 
in references [Ref. 18, 19, 20, 21], produces local track data bases consisting 
of the target state vectors and estimation error covariances at specific points 
of time. Typically, the local track data base will contain kinematic 
information and sometimes attribute information is included. The typical 
Kinematic information would be : 


ae (kIk) -- The target local track estimate at time kK using the local sensor 


data of node j, 1.e 
RY E(x) 122) 

p J (KIk) -- The local error covariance matrix associated with the target 
local estimate x' *(kIk), Le 

pis wi x! 2! cx! RT Z4Y 
Thus, (x I p' 4) records are created by processing the raw sensor for each 
node with an appropriate filter (local estimator) to produce the local track 
data base. 

Before fusing any two tracks from two different nodes. the two tracks are 
referred to the same coordinate system using the required transformation. 
and to the common time instant using the prediction equations of the Kalman 
filter [Ref. 22]. 


Rate Jeotit, ) eet, ky (4.22) 
Z (4.23) 


and p' tlt, =o (lt, ) pe, h ) 
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Where tis the common time instant 
t ij is the time of the last updating for the ith track of the jth sensor 


ry is the transition matrix of the target model 
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FIGURE 4.3. Processing of Radar.Data at Each Node in HEA 
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V. LOCAL ESTIMATION 


A. LOCAL ESTIMATOR FUNCT IONS 

Generally, the determination of position and velocity of a target using 
radar measurements such as range, bearing and range rate, is a problem of 
nonlinear estimation. In many cases, the relationship between the 
measured data (e.g, range, azimuth, doppier velocity ) and the target 
dynamic parameters is nonlinear. A rigorous treatment of the nonlinear 
estimation problem requires the use of stochastic integrals and stochastic 
differential equations. The optimal ( conditional mean ) nonlinear estimator 
cannot be realized with a finite-dimensional implementation, and 
consequently, all practical nonlinear filters must be suboptimal [Ref. 19]. 

As shown in Figure 5.1, the local estimator performs the functions of 
track initiation, plot-track correlation, track prediction, track filtering, and 
track termination. An overwhelming number of approaches to filtering and 
prediction for multitarget tracking have been developed recently in response 
to the ever-increasing importance of the subject. However, at this stage of 
development, no standard approaches are generally accepted for ail 
applications. A wide variety of techniques have been proposed for many 
diverse applications, but the multitarget system designer must choose the 


techniques best suited to his particular problem. 


67 


PREDICTED TRACK 


PLOTS : 
n FILTRING DISPLAY 
Nc cure 
FROM 
DATA 
EXTRACTOR 
TRACK 
TERMINATION 
<> 


OLD TRACK 








TES 


FIGURE 5.1 Basic Functions of Local Estimator 
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There is a comprehensive set of papers that illustrate commonly known 
techniques for solving the multitarget tracking problem. Among them is the 
paper by Reid [Ref. 23], the survey paper by Bar-shalom [Ref. 20], and the 
paper by Chang [Ref. 19]. There are two most commonly used conventional 
approaches to filtering and prediction for multitarget tracking [Ref. 18]. The 
first is to use fixed tracking coefficients, like the @—68 tracker and the a-8-¥ 
tracker (Ref. 18, 24, 25, 26] which has computational! advantages for 
systems with iarge numbers of targets. The second is Kaiman filtering 
which generates time-variable tracking coefficients that are determined by a 
priori models for the statistics of measurement noise and target dynamics. 
So, a Kaiman Filter (KF) is a computational aigorithm that processes 
measurements to deduce a minimum variance, unbiased error estimate of 
the state of asystem by using the system and measurement dynamics, 
assumed statistics of system noises and measurement errors, and known 


initial condition information. 


B. CONVENTIONAL KALMAN FILTERING 

With expanding computer capabilities, the Kalman filtering is becoming 
increasingly more appealing to the system designer. The Kalman gain 
sequence is chosen automatically, based on the assumed target maneuver 
and measurement noise models, which means that the same filter can be 
used for varying targets and measurement environments, by changing a few 
key parameters. Also, the Kalman filter provides a convenient measure of 
the estimation accuracy through the covariance matrix. This measure is 
required to perform the gating and correlation functions accurately. In 


addition, having a measure of the innovation sequence, is useful for 
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maneuver detection, and upon maneuver detection the Kalman [filter model 
provides a convenient way to adjust for varying target dynamics. The five 


equations for the conventional Kalman filter are: 


¥(KIK-1) = @ X(K-IIk-1) + w State extrapolation (Sem 
p(kik-1) = @ p(k-Iik-1) $) +Q error cOVariance extrapolation (5.2) 
K(k) = p(klk-1) Ei (Hiap(kik-1) ie Kalman gain (5.3) 
pikik) = (1 - KH ) p(kIk-1) error covariance update (5.4) 
X(KIk) = X(KIK~1) + K (2(k) - H X(KIK-1)) state update (5.5) 
x(kIK- 1) time updated state vector 

*«(KIK) measurement updated state vector 

ici) time updated error covariance 

o(kik} measurement updated error covariance 

} State transition matrix 

K Kalman gain matrix 


identity matrix 
measurement transformation matrix 
measurement error covariance matrix 


process noise 


eee ce 


process noise covariance matrix 

wk) = (2(k) - H X(KIK=1)) measurement residual 

Wk) = H p(klk-1) H'+R measurement residual covariance 

Once the initial state x(010) and the initial error covariance matrix 9(0|0) 
are established, the Kalman equations can be activated. Figure 5.2, shows a 


simplified scheme of Kalman filter operation. 
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When Kalman introduced these equations ((5.1) - (5.5)) 27 years ago [Ref. 
29], they offered the engineering community a means to model discrete - 
time systems via the state-space modeling method for multivariable 
systems. Unfortunately, when the state equation was written for the 
tracking applications, Kalman’s conventional equations were found to fall 
short in two respects: 

a. Finite wordlength comoutation. 


b. Changing system dynamics mode! in real time. 
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Figure 5.2. Simplified Scheme Of Kalman Filter 
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C. THE EXTENDED KALMAN FILTER 

For nonlinear modeling problems, the Extended Kalman Filter (EKF) is 
used to extend the linearized Kalman filter design by relinearizing about 
each estimate ( i.e, Kalman equation (5.1)) once it has been computed. The 
sucess of the method of linearization about a nominal trajectory in state 
space depends upon the accuracy of the nominal trajectory. This technique 
has little hope of success in a situation where there is almost no prior 
information about the trajectory as in the situation of the target acquisition 
problem. Here, a psuedo a priori may be generated from the incoming 
observations. In EXF, as soon as a new state estimate is made, a new and 
better reference state trajectory is incorporated into the estimation process. 
In this manner, one enhances the validity of the assumption that deviations 
from the reference (nominal) trajectory are small enough to allow linear 
perturbation techniques to be employed with adequate results [Ref. 27]. 
Radar measurements ( range, azimuth, elevation, and possibly range rate) 
are in polar (spherical) coordinates. Thus there exist a known, nonlinear 
relationship or transformation between the state of the system and 


observations. 


Vi 
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(TWS Radar ) 





DOWN 
Z To Centre Of The Earth 


Figure 5.3. NED Coordinate Frame for TWS System 
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Assuming NED coordinate frame shown in Figure 5.3, where X,Y,and Z are 
North, East, and Down, respectively. The NED coordinate frame is chosen 
because it is applicable for surface (ground or shipbased) tracking systems, 
in addition that it !s particularly useful for airborne systems. As shown in 
Figure 5.3, the origin of an aircraft tracking system is the TWS system site. 
It is worth to note that the NED system is not strictly an inertial system for a 
moving platform because the platform axes are slowly changing their 
Orientation in space as the vehicle moves over the earth's surface. However, 
except near the North pole the effects of the rotations are negligible, and the 
NED svstem is essentially inertial for aircraft platform. For the coordinate 
system shown in Figure 5.3, we will have the following relationships 


between spherical (polar) and cartisian coordinates 


Range Pepe ky ence (5.6) 
Azimuth gy = arctan (y/x) (5.7) 
Elevation $= arcsin (-2/r) (5.8) 
Range rate 9 =(xx+yy+zz2)/r (5.9) 
Denoting that ; 

Xo = X (kKIK-1) | Xo = x (kIK-1) 

poe ae #2 (kiK-1) (5,10) 
ihe. 3522 (Kik-1) 


r> = (x, < "he ‘ Z5 9.5 


The corresponding measurement transformation matrix H, is given Dv 


[Ref. 28] 
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ny O nz O Nhs OO ) Range 
ha O oz O 0 0 ) Azimuth (5.11) 
in nz O fz O Nas =O ) Elevation 
Nay Mag Maz Nag Nag Nag  ) Range Rate 
4 Measurements eS 


6 States 
Where 
Ny ae oe alin 
fee = Vo/l 
Mem = Zo/ To 
Nor =~ Vo /(Xo°* Yo") 
pen = X_/(Xo°* Yor) 
hy = 25Xo /((Te2Xe2 + Vo" )0.5 ) 
haz = Ve Ze/((re“VxQ2+ Ye? )°) 
Nag = (— (xe? + VQ OP) Mr (5.12) 
TM = (Xo/ Ce) - (CX (Xs Xs YoVo* ZoZe)) / le?) 


fom =" Xa7 7, 

ae = (Vers) -(( yolXoXe* YoVe* ZeZe)) (Teo) 
mae = Ye7l, | 

Mem = (2, /'Po) = (26 (Xo %o* VoVo* ZeZe)) / lo) 


Nag = wale 


D. UD COVARIANCE FACTORIZED KALMAN FILTER 
The most troublesome numerical aspect of the Kalman filter is the 
measurement update of the error covariance matrix, so the properties of 


alternate computational forms are of substantial interest. Potter [Ref. 30] 
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introduced a square-root approach for propagating the error covariance 
matrix in the absence of process noise. This method is completely successful 
in maintaining the positive semidefinite nature of the error covariance, and 
it effectively reduced the precision requirements to about half the number 
of bits needed for the full covariance update. The outstanding numerical 
Characteristics and relative simplicity of this Potter square-root approach led 
to its implementation in the Apollo navigation filters [Ref. 31]. The 
numerical characteristics of the filter have been further improved upon by 
Agee and Turner [Ref. 32], Carison [Ref. 33] and Bierman [Ref. 34], among 
others. The benefits of square-root filters were attractive in the sense of 
relieving the numerical problems and maintaining symmetry of the 
covariance matrix. Bierman’s method requires the fewest arithmetic 
operations of the square-root formulations. Bierman’s UD filter factorizes the 


covariance matrix P in the filter as follows 
P-UDU (5.13) 


where U is an upper triangular matrix with |'s along its main diagonal and D 
is a diagonal matrix. The UD algorithm requires a diagonal measurement 
covariance matrix R, which implies that the measurement errors are 
uncorrelated. [f the matrix is not diagonal, it can be made diagonai as 
indicated by Yannone [Ref. 35]. Bierman derived a recursive algorithm for 
implementing a Kalman filter in terms of U and D, rather than o (Ref. 34, 
36]. 
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E. PARALLEL KALMAN FILTERING 

In general, real-time filtering cannot be performed on large-scale 
problems using a uniprocessor architecture because serious processing lags 
can resuit. The Kalman filter can be extended to a much greater class of 
problems by using parallel processing concepts. Full utilization of 
paralleiism can be obtained through insight in the structure of the problem 
and decoupling of arithmetic processes to permit concurrent processing. One 
must simuitaneously deveiop the parallei aigorithms for solving the filtering 
problem, and the associated processor architectures to achieve the maximum 
benefits from parallelism. Parailel Kalman filter architectures based on this 
design methodology can be implemented with VLSI/VHSIC technology [Ref. 
37). VLSI technology allows the designer to map system level! architectures 
directly into hardware. To date, relatively little research has been conducted 
on restructuring the Kalman filter for paraile! processing. Three approaches 
that have been considered include [Ref. 37]: | 


a, Vectorizing the standard Kalman filtering equations by running the filter 
on a vector (or array ) processor [Ref. 38]. 


b. Uncorrelating the measurement data to the filter so that each 
measurement can be pipelined into each processor simultaneously 
(Ref. 39]. 


c. Decoupling the predictor and corrector equations in the filter so that 
these computations can be evaluated simultaneously on separate 
processors using multiprocessing [Ref. 36, 40]. 


Although the first approach can speed up computations considerably over 
conventional techniques ( speed-up factors of 6 to 10 have been realised 
[Ref. 38]), the computational throughput was limited primarily by the 


architecture of the array processor. This occurred because the array 


a, 


processor architecture was optimized for Fast Fourier Transform (FFT) 
computations, not Kalman filter computations. 

An approach based upon mapping the Kalman filter equations directly 
onto a highly paralle!/pipelined architecture can be used. Thus, the parallel 
Kalman filters algorithms/architectures developed in [Ref. 36] exploit the 
structure of the filter to improve throughput using pipelining and 
multiprocessing. This approach to speed up Kalman filter computations is to 
perform paralle! processing at three major levels: 


1. The measurement data to the filter is uncorrelated so that each 
measurement can be processed simultaneously. 


2. Tae predictor and corrector equations of the Kalman filter are decoupled 
so that the predictor and corrector can be computed on separate 
processors. 


3. The measurement data are pipelined into each processor. 

Thus, multiprocessing and pipelining are combined to achieve large 
improvements in computational speed. Each processor architecture can be 
implemented with VLSI technology. To facilitate parallel processing and 
pipelining, the measurement data to the filter should be uncorrelated. The 
data can be uncorrelated by diagonalizing the covariance matrix associated 
with the measurement noise in the filter. Procedures for uncorrelating the 
data generally utilize coordinate transformations based upon eigenvalue or 
singular value decomposition [Ref. 41]. If the eigenvalues of R are not 
distinct, ihe generalized eigenvectors of R must be determined (Ref. 41]. 
Similariy, if the eigenvalues of R are complex, R can be transrormed to a 


block diagonal matrix [Ref. 41]. 
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F. ROBUSTNESS OF THE KALMAN FILTER 

An important part of the design of the Kalman filter is to regulate the 
robustness of the filter to handle deviations from the prescribed systems 
dynamics model in the cases when the target makes heading changes. 
Without some form of re-modeling adaptively in real-time, the filter 
diverges. When the conventional filter is emulated for constant 
velocity/constant heading targets, filter divergence results after a number of 
iterations, and the error covariance matrix goes negative definite. This lack 
of reliability forces the seeking of a more stable algorithm for implementing 
the Kalman filter. The estimator eigenvalues control [Ref. 28], can be used. 
In a Kalman filter. this amounts to the eigenvalues of ( - KH). The control 
for any given (¢ , H) pair, is a function of K , K is a function of p(k+IIk) , and 
p(k+ 1|k) is a function ofQ. 

Whatever method is adopted for track filtering, it is usually necessary to 
combine it with some form of adaptation. An adaptive system is one which 
continually adjusts its own parameters in the course of time to meet a 
certain performance criterion. On-line adaptation is required when 
significant changes cccur in the target motion (maneuvers), measurement 
accuracy or frequency of detection. The excitation noise covariance Q is a 
Statistical quantity used to cover uncertainties in the model of target motion 
described by (4.5). Measurement accuracy is described statistically by the 
noise covariance &, and the interval between filter updates is given by the 
time T ( which appears in $,Q(k)). Changes in the tracking environment 
must be reflected in the appropriate adjustment of these three filter 


parameters during the track estimation process. Adaptive tracking requires 
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the on-line computation of a figure of merit , or track performance indicator, 
which typically involves a weighted combination of terms in the residual 
(the innovation sequence) w(k). It also requires a practical procedure for 
determining what quantitative adjustments should be made in the filter 
parameters. Two approaches can be used to control the filter performance: 


a. The system's eigenvalues are fixed and kept constant. By holding the 
eigenvalues constant, a prescribed degree of stability is maintained. 


o. A threshoiding technique is mechanized to adaptively mode! 
maneuver ing/nonmaneuvering targets. 


The first method, which computes the eigenvalues as function of the Q- 
matrix with constraints based upon the damping sought (critical, 
overdamped), starts with Kalman equations (5.2), (5.3), and (5.4): 

K = function of (p(k+1/k), R, H) 
p(k+ Ik) = function of (p(kik), Q, $) 
Solving generally, for p(k+!|k) and substituting into the equation for K leads 
to the stability: 
( - KH) = function of (p(kik), Q, , R, H) 
The eigenvalues of (@ - KH) can be sought, to yield a characteristic 
polynomial 
deere a aa +a, ihe ee aan (5.14) 
For n = 6, (5.14) will be 
q(2)= Esa Pra era, fsa, brake, (5.15) 
Values of , througa ¢, can be chosen to yield a prescribed system response 
in the z-plane. The unit circle represents underdamping (marginally stable 
system, poles on the jw-axis in the s-plane). Within the unit circle 


represents either critical or overdamped system responses. Selecting critical 
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damping leads to a polynomial q(&). The coefficients of the polynomial are 
functions of (p(klk), Q, @,R), from which equations of all non-zero Q- matrix 
elements can be computed as functions of p(k/k), @,R, and constants. Thus 
constrained eigenvalues of (@ - KH) imply a prescribed system response 
(critical, underdamped, or overdamped). They are regulated by resulting 
expressions of variable Q- matrix elements, which are, themselves, a 
function of p(kik), &, and R. 

The problem with this is that the optimum estimates may not always be 
derivable from a priori, critically-damped eigenvalues. Keeping the filter 
bandwidth open (high) all the time is not the optimal solution for the 
multitarget tracking problem. As a consequence, the other method is more 
adequate. 

The second method is a thresholding mechanism to adaptively open and 
close(i.e., raise and lower) the filter bandwidth based upon infor mation 
about the target's actual activity. Trial and error led to a ‘high’ and ‘low’ Q 
based on the range and range rate residuals. Emulation of the system TWS 
estimator revealed that a system response lag of one frame could be 
accom modated by evaluating the residuals prior to evaluating Kalman 
equation (5.2). If the threshold was broken, the Q- matrix was set to ‘hign’ 
or “low” accordingly, then equation (5.2) was evaluated with this selscted Q. 
This effectively gave the filter a “sneak preview’ one T ahead with which to 
optimize the system robustness/stability. The fact that the system dynamics 
mode does change is the reason why the first method is not recommended to 
be used. The Kalman filter stability/robustness control can be summarized as 


the following: 


8! 


E( - KH) me = stable 
E(@ - KH) > marginally stable (Sion 
E( - KH) al => unstable 


a. Transient response varies with the closed loop filter pole locations. 


b. The input to the Kalman filter which gives an indication that the target 
iS Maneuvering, are the residuals. 


c. Residuais regulate @, and Q regulates Kalman fiiter bandwidth. 
robustness, and stability. 


When a high Q ts used on a non-maneuvering target, the filter is being 
erroneously told that the constant velocity/constant heading svsitem 
dvnamics mode! is being violated when tn fact it isn't, and vice versa. 
Conseqently, the filter estimates are noisier (less accurate) for non- 
maneuvering/high’ Q than necessary, and conversely, the filter diverges 
(breaks track) for the maneuvering/“low” Q case. In addition to the 
adaptive thresholding techniques, the state vector estimate accuracy was 
improved by performing a relinearization about the best estimate 
sequentially for each measurement made. Figure 5.4, shows the sequence of 


computations. 
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COMPUTE EQ. (3.1) | 


f 


| COMPUTE RESIDUALS | 


SET “HIGH/LOW" 
Q 










MEASYREMENT 
Oe 





COMPUTE EQ (S.2) 






NEXT MEASUREMENT 


COMPUTE H 
A 
COMPUTE K, P, x 


A 
x, P 


FIGURE 5.4. Computation Sequence and Sequential Relinearization 
About The Best Estimate | 
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G. MULTITARGET LOCAL ESTIMATORS 

It was not until the early 1970's, that multitarget tracking theory became 
a major topic of interest [Ref. 15, 18]. The papers by Singer and Stein [Ref. 
42], Singer, Sea and Housewright (Ref. 43], Jaffer and Bar-shalom [Ref. 44], 
Bar-shalom and Tse [Ref. 45], began the development of modern multitarget 
tracking techniques that combine correlation and Kalman filtering theorv 
(Ref. 15, 18]. In a dense target environment, gating only begins to solve the 
problem of associating observations with tracks. Additional logic is required 
when an observation falls within the gates of multiple target tracks or when 
multiple observations fall within the gates of a target track. 

Figure 5.5, illustrates a typical situation in which both types of conflict 
occur. This logic is required to face the ambiguity about the origin of the 
observations, which originated from the target of interest. The correlation 
function takes the output of the gating function and makes final observation- 
_ to-track assignments. The various measures proposed against the 
correlation conflict in automatic tracking can be reduced to the two 
substantial principles : 

1. Application of the nearest- neighbor- rule. 


2. Application of branching procedures. 
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Gate 
Gate 


Gate 


Q1,02,03 Observation Positions 
PARP ZeP 5 Predicted Target Positions 
Figure 5.5. Exampie of A Compiex Conflict 


Situation 


1. Nearest-Neighbor Approach 

The nearest-neighbor-rule prescribes correlation of that track-result 
which is statistically nearest to the target's predicted position (the search 
plot in case of track initiation). It is based on the assumption, that the 
return which is nearest to the predicted position, is most probably the true 
target's return. The nearest-neighbor-rule is capable of solving satisfactorily 
the correlation conflict. At smaller target distances it fails to solve the 
conflict, because miscorrelations generally produce deviations of the track 
and target trajectory and finally lead to target loss. The track uodating 
process typically Degins with a gating procedure that is used to eliminate 
unlikely observation-to-track pairings. The simplest multitarget system use 
sequential data processing and the nearest-neighbor association rule. For 
example, this is normally the approach used with aT WS system. With this 
approach, processing is done at each scan using only data received on that 
scan to update the results of previous processing. The nearest-neighbor 
assignment algorithm assigns observations for existing tracKs in a manner 
that minimizes some overall distance criterion. It looks for a unique pairing 
so that al most one cbservation can be used to update a given track. Using 
this approach, the optimal solution is obtained by assigning observations to 
tracks in order to minimize the total summed distance from all observations 
to the tracks to which they are assigned. A computationaily efficient 
suboptimai soiuticns, also can de used to illustrate one suboptimal solution. 
To illustrate one suboptimal solution, the example shown in Figure 5.6, is 


solved using the following rules: 
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{oa 


. OL is assigned to T! because O1 ts the only observation within the gales 


of Tl while T2 has other observations (02, 03) within its gates. 


Re. | . 2 2 
. 03 is assigned to T2 because 03 is closer than 02 (d5.<422 ). 


O04 can, without question, be used to initiate a new track, but new track 
imitiation using OZ may be restricted. This restriction ts based upon the 
practical consideration that multiple observations within the gate of a 
single established track are often the result of a failure in the 
observation redundancy-elimination logic. Thus, this restriction serves 
to prevent initiation of extraneous tracks. 
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Gate 





01, 02 03, 04 = Observation Positions 
= Predicted Target Positions 


pl, p2 
dG = Distance From p2 to 02 
d = Distance From p2 to 03 
Figure 5.6. Example of Gating and correlation for Two 


Closely Spaced Tracks 
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Simple assignment techniques, such as the sequential nearest-neighbor 
approach, can lead to miscorrelation with poor tracking as a consequence. 
The problem with choosing the nearest-neighbor is that, with some 
probability, it is not the correct measurement. Therefore, it will use 
(sometimes) incorrect measurements while believing that they are correct. 
This can lead to the loss of target. 

An alternative to nearest-neighbor correlation is the “all neighbor’ 
approach, which incorporates ail observations within the neighborhood, as 
defined by the gate around the predicted target position. The position 
update is then based on a weighted sum of all observations, with the 
weighting calculated using probability theory [Ref. 45]. This procedure is 
called Probabilistic Data Association (PDA) since it associates probabilistically 
all the neighbors to the target of interest. Then this probabilistic information 
is used in a suitably modified tracking filter, called PDA Filter (PDAF), That 
accounts for the measurements origin uncertainty. Later results [Ref. 21,46] 
showed that the PDA did not perform well in the presence of multiple 
targets, so a modified method denoted Joint Probabilistic Data Association 
(JPDA) was derived to include the presence of multiple targets [Ref. 21]. 

2. Branching Procedures 
Branching procedures use all the results within the correlation gate in 
order to form new tracks. So, at every sampling time when there is more 
than one measurement in the validation region (correlation gate) the track is 
split. The likelihood function of each split track is evaluated in order to 
eliminate unlikely tracks. Tracks whose likelihood is below a given 


threshold are disregarded so as to keep the number of branches finite. The 
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likelihood of a measurement Z(k), under a given assumption ; for the model 


is obtained from z(k) and the predicted state x(KIK-1) as 


0 (2K) = Cexp F1/2 v (kW (kak) (5.17) 


When c is a normalizing constant. In the track- splitting techniques, it is 
necessary to evaluate the likelihcod of a whole track, i.e. of a succession of 
plots. The fundamental limitation of the maximum likelihood techniques is 
that no validation test 1s made to control the truth of a given assumtion. 

This in practice leads to a feedforward approach to adaptivity by comparison 
with the feedback concept underlying the Bayesian aporoach. The branching 
procedures are marxed by an unavoidable increase in the number of 
branch-tracks in comparison to the number of real targets. With regard to 
the application in a real-time system, these methods are generally 
computationally costly, so they are often inappropriate as true supplement 
to the nearest-neighbor approach. 

Involving large computer burden and extensive memory requirements, 
sub-optimal techniques are generally preferred, leading to simplified 
algorithms and requiring storage of less data. In practice, a trade-off 
between cost and effectiveness is needed to select the most appropriate 
algorithm for each application. In HEA ap proach, the output of the local 
estimator is assumed to be tracks which are formed and confirmed with 


great confidence and low degree of uncetainty. 
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VI. ALGORITHMIC TRACK FUSION 


A. TRACK-TRACK ASSOCIATION 
Let x ‘be the local state estimate of a target 1 by a senscr 1 and X IJ 


the locai state estimate of a target j by a sensor j. Local estimates X : ‘and 
x 45 couid be for the same target or could be for different targets. it is 
desired first to test the hypothesis that these estimates pertain to the same 
target, in which case the two tracks will be associated as having a common 
origin. The optimal test would require the entire data base through time x 
and is probably not practical. [n view of this, the test is carried out based 
only on the most recent estimates. 

The decision as to whether track “1° provided by node “i" and track “j" 
provided by node ‘3’, should be associated can be posed as a test of 


hypotheses by defining a distance between the two tracks, so 


J) (ij)- nx ''- X24 yp (6.1) 
where | x''- X27 is the norm of [x ''-x 44] 
mx Fee FAT ERE. gy Ja yyos 

_ p12 iste iT ti diy 

- (te BU IS 4% 
The distance between two vectors in the space is defined in the usual way 
irom the norm of a vector , 30 


Ati 


nx tex Pop? pg REZ aye Eg ay (6.2) 
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Which is assumed to have a Gaussian distribution. The superscripts i and j 
denotes the tracks i and j and (i,j) denotes the nodes i and j respectively. 


The statistical test is 
Hy 


pe { dea pea aaa S$ 2 (6.3) 


H 


© 


Where hypothesis d aS track i and track } belong to different targets 
hypothesis H, ; track i and track 4 belong to the same target 

and a? can be chosen based on that r will have a chi-square distribution 

with the number of degrees of freedom equal to the number of elements in 

the state vector. The covariance matrix for the statistical distance P and the 

resulting fused track can be given using the techniques mentioned in 

[Ref. 47]. 

The test to accept or reject the hypothesis that the two tracks are from the 

Same target is defined using the similarity threshold a- 

r a2 tracks are from the same target 


r >a , tracks are from different targets 
It is noted that inthe H, hypothesis Ef d'?(ij)}=0. The choice of a2 will 


be Dased upon the chi-square properties cf r with some experimentation 
probably required for the particular application. The value of a2 would also 
probably be chosen as a function of the target density if known [Ref. 18]. 
Also 32 can be chosen ?o achieve a specified probability of correct association 


Po. 


o2 


B. PROBABILITY OF CORRECT ASSOCIATION 

Evaluation of the correct association probability Pc is now considered. The 
probability of false association P- can be found in a similar way but with a 
cumbersome calculations, owing to the non-zero mean value of a ; (i,j) . The 
probability Pc is equivalent to the probability that q' ; (i,j) lies inside the 
hyperellipsoid in the n-dimensional space, defined by equation (6.3). It can 
be computed by rescrting to an ortho-nor malization procedure of the matrix 
P, which transforms the hypereilipsoid into an equivalent hypersphere. 


Hence, 


3 
Bs ij exp( - r* /2) p(r) ar (6.4) 


0 


Pe = {/ (21) 
Where pir) dr is the symmetric volume element in the in the n dimensional 


space. For n=!,2,3,4, this expression particularises to 


For n=] 


a 
Po = v 2/T i exp( - r4/2) dr =2€ (a) (6.5) 
0 


Where € (.) is the error function defined as 


3 = 
€ (a) = 1/ v 2m J exp( - 2*/2) dz (6.6) 
0 
For n=2 
3 
Pe = i) rexp( - r*/2) dr =i- exp( - a*/2) (6.7} 
0 
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For n=3 


3 
Po= Vv 2/T1 ih r- exp( - r¢/2) dr = 2€ (a) - V 2/ma exp - a*/2) (6.8) 
0 


For n=4 


a 
=e f rSexp( - r2/2) dr =1- (1+ a2/2) exp( - a4/2} (S799 
0 
As an example, the values of P. for n= 1,2,3 and 4 are shown in the 

tables 6.1, 6.2, 6.3, and 6.4 respectively. It is noticed that from the results 
given in the previous mentioned tables that, for the same similarity 
threshold a, the prebabilitv of correct association decrease as the number of 
elements in the state vector increase. Generally, with a=3, a high probability 
of correct association is obtained. The results presented in tables 6.1, 6.2, 
6.3, and 6.4 is produced by an innovative PC software product called 
TK!Soiver (see Appendix B). Tk!Solver shortcuts the problem-solving process 
by eliminating two steps of developing an algorithm and writing a program. 
Instead, the user puts the mathematical model expressing the relationships 
Detween the variables directly using standard algebraic notation. [n other 
words, the user communicates with the computer at the level of 
relationships (represented by equations) rather than at the level of 
sequential prcegrams and assignment statements. In it, the input and output 
information resiGe in 4 set of 2ignt sheets and three subsheets inat are 
viewed on the screen. The principal ones are the Rule Sheet, used for 
entering and displaying the equations or rules, and the Variable Sheet, used 


for displaying the variable names. The Variable Sheet also serves for 
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assigning input values and units as well as for displaying the results of the 
solution. As an example, Figures 6.2, 6.3, and 6.4 show the variable and rule 
sheets of equations 6.5, 6.7, and 6.9 respectively. Konopask and Jayaraman 
view [K!Solver by itself as an expert system primarily in the area of 


numerical problem solving (see Appendix B). 
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TABLE 6.1. PROBABILITY OF CORRECT ASSOCIATION FOR n=1 


dg Po 
0.5 0.371773290 
1.0 0.666557870 
iS 0.8886040141 
2.0 0:97 95005 
Z> 0.985390484 
3.0 0.999999853 
35 1.0 
4.0 1.0 
45 1.0 
5.0 1.0 
5.5 1.0 
6.0 1.0 
6.5 1.0 
70 1.0 
iD 1.0 
3.0 1.0 
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TABLE 6.2. PROBABILITY OF CORRECT ASSOCIATION FOR n=2 


a Pe 

0.5 0.117503097 
1.0 0.393469340 
iD _  0.675347533 
2.0 0.864664717 
25 0.956063066 
3.0 0.98889 1004 
3.5 0.997812509 
4.0 0.999664537 
4.5 79959955 
5.0 0.999996237 
DS 0.999999730 
6.0 0.999999985 
6.5 Oo 29999 
7.0 1.0 

iD) 1.0 

8.0 1.0 
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TABLE 6.3. PROBABILITY OF CORRECT ASSOCIATION FOR n=3 


qa Pe 

Oe 0.019708344 
1.0 0.182616987 
1.5 0.500087808 
2.0 0.763596943 
2.5 0.897749084 
3.0 0.973408794 
S 0.993891228 
4.0 0.998929359 
4.5 0.999856 146 
5.0 0.999985142 
aS) 0.999998815 
6.0 0.999999927 
6.5 0.999999996 
7.0 1.0 

Vis) 1.0 

8.0 1.0 
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TABLE 6.4. PROBABILITY OF CORRECT ASSOCIATION FOR n=4 


a Pe 

0.5 0.007190985 
1.0 0.090204010 
{.5 0.310113507 
2.0 0.593994150 
Ao 0.818760149 
3.0 0.938900519 
5 0.984414126 
4.0 0.996980836 
4.5 0.999554274 
5.0 0.999949690 
~~ 0.999995647 
§.0 0.999999711 
6.5 —— -9,999999985 
7.9 0.999999999 
TD 1.0 

8.0 1.0 
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FIGURE 6.1. Probability of Correct Association P- Versus Similarity 


Threshold a For Different Dimensional Space n of The 
State Yector 
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194/! 











[mr ) Rule: 
VARIABLE SHEET 

Se Lnput Name Output Uruire Comment 

c Ee .88864014 Probability of correct association 

= O a 

im i Function values 

m O x Values of independent variable 

@ S i713 7466 Approximate value of integral 

mel. 5 ez . Upper limit 

Be O xl Lower limit 

iE O Cc Coefficients in simpson’s formula 
RULE SHEET 

S Rule 


* feexp(-(x°2)/2) 
* S=(x2-x1)/(3*10)*dot('’c,'£) 
* Pe(2/sqrt(6.2832))*S 


FIGURE 6.2. Variable and Ruie Sheets For Equation (6.5) 
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Peo ee Ges rere 201/! 


VARIABLE SHEET 


Scene npc Name Output Unit Comment 

70 a 

Ie P 

(lr) Rule: P=l-exp(-(a*2/2)) . 201/! 


S Rule 


FIGURE 6.3. Variable and Rule Sheets for Equation (6.7) 
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RULE SOHEE TL. 
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FIGURE 6.4. Variable and Ruie Sheet for Equation (6.3) 


Comment 
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C. COMPOSITE ESTIMATE OF TWO TRACKS 

Since the tracks are from different sensors and at the same time instant, 
the notation for sensors and time are dropped for simplicity of notation. If 
the tracks are independent, the covariance matrix P for a ’ is defined as 

p-p's p- (6.10) 

Bar-Shalom [Ref. 33], has pointed out that the covariance defined by (6.10) 
and the resultant formation of r are not strictly valid Decause of error 
correiation between the two sensor estimates. This correlation occurs, even 
if the measurement errors are independent, because cf the common errcr 
source due to the target dynamics that are seen by both sensers. A 
technique outlined below, tc account for this error correlation can be applied 
to modify the covariance matrix PD. 

Define a cross covariance matrix p' 4 such that the initial condition is 

p'*(010) = 0 


Then, for k> 0 values of p 7k k) are computed using the recursive 


relationship : 
p'3(kik) = a’ (k) B(k-1) { A¢(kK) I (6.11) 
Where 
A'(k) =1-K)(k)h’ (6.12) 
At(k) = 1- K2(K) he (6.13) 
B(k-1)= @ p'2(k-11k-1) (@9)' + Q(k-1) (6.14) 


The superscripts i and j refer to sensors i and j, vnile ®X.A, and Q are 
defined for the Xaiman filter [Ref. 48,49]. Finally, the modefied covariance, 


replacing that given by (6.10) becomes [Ref. 47! 
popip?- pi?- ipo). (6.15) 
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For combining tracks, we begin by considering the fusion relationships for a 
scalar such that a composite estimate, using estimates 
x =x) + c( x - x) (6.16) 
Where c is a weighting factor that will be chosen so that the expected Mean 
Squared Error (MSE) on xis minimized. The error in x‘ is defined as 
Axe = AX’ + c( AX’ - AX’) 
Then, the error variance on Ax’ is defined as 
= £ [( AX" )2] = 02+ 2c Ef Ax’ Ax? | - 2c On*+c*o,* — (6.17) 


Where | 
o2 -E(Ax')7], 9 2 - Ef ax? J], 


Oy? = El Ax - Ax 7] = 02+0,2-2E[ Ax! AX’ 


The correlation between errors is defined as 
Al A? 12 
EL Ax Ax’ ]-R 


Equation (22) becomes 
e* = (1-2c + c7)o.2+ c20,2+2(c- c2) R™ (6.18) 


In order to form the minimum MSE estimates, we have 
e”/ Oc = -2 (1- co, +2c 0,2+2 (1-2c )R = 0 (6.19) 


Solving (6.19) for c gives 


C= io. ars a Cac ng 2 Pus) (6.20) 


In the special case of no correlation 
1 
R 2 QO , we have 


A} AQ At 
oe =X +la?2/ cane )IK x -x ) 
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= (0,2%'+ 02x (02+0,2) (6.21) 
In the case of combining state estimation vectors ( x , x? ), the same 
general relationships given by (6.16) and (6.17) are used, except that the 
Variances become covariances: 
a -9 p| oe ~— p- 
2k” ee (99 
and c becomes a weighting matrix: 
a yh p i 5! a 47- (p” yt y! (6.22) 
Finally, using (23) and (25), the resulting error variances (or covariances) 
are | 
o2 (X°) = Gree: R*)27 | of +a,° 22 R* ) (6.23) 


In the special case of no correlation ( R* =0 ), we have 


o7 ("Or g2/ ( CAamer (6.24) 
So, generally in the vector case, the resulting combined vector, which 


minimizes the expected error is 


A 


xo =x! +c (xI- x) (6.25) 
¢ =(p- pores 
and the covariance matrix associated with the estimate of (6.25) is 
Pe-p-(p- ge Cpeepe) (6.26) 
As a simple example 
Consider the two estimates, 2ach a 2- dimensional vector, with the following 


covariance matrices 
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Figure 6.5. presents the lo ellipses corresponding to these maitrices, 
namely 

x (pk = i= 1,2 (6.27) 
and lo ellipse corresponding to the fused estimate whose covariance is 


“hy? (6.28) 


P- 9 (p+ 9°) 
The reduction of the uncertainty are noticed: the ellipse corresponding to the 
fused estimate is strictly smaller than the intersection of the two ellipses 
prior to fusion | 


Figure 6.6. shows the ellipses of uncertainty corresponding to 


1 110 S 
Dp = 
5 10 


Pee -§ 
Dp = 
-6 10 


and the resulting fused estimate according to (6.25). 
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mA 





FIGURE 6.5. Error Ellipsoid For Fused Independent Tracks 
in Example | 
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FIGURE 6.6. Error Ellipsoid For Fused Independent Tracks 
in Example 2 
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D. OPTIMALITY OF HEA TRACK FUSION 


Assuming that there are two sites (nodes) at which the same target is 
tracked. At each site, each local estimates x4 (kik), with the corresponding 


p. ‘ (kik) are computed. Hence, in this situation we are concerned only about 


one target, the superscript 1 is dropped for the simplicity of notations, and 
there will be x? (kik) with its corresponding p? (kik), with j=1,2. 


Assuming the local measurements at each site are 


24k) = H%k) x(k) + vk) j= 1,2 (6.29) 
with RAK) the corresponding measurement noise covariance. 
Denoting 
2k) - z'tk) 
BZ ilk) (6.30) 
HXk)= | HW 
H“(k) (6.31) 
ak) ~ IR(k) 0 
0 = Rk) (6.32) 
Using the matrix inversion lemma 
co 2H Re HP =") - oH (HpH +R) Hp (6.33) 
which can also be written as 
(p+HRH )' =p -p H(H pH +R) Hp. (6.34) 
the recursion for the covariance p(klk) can be rewritten as 
p(kik) = { p(kik- 1)! + H/(k) R(k) (KDE (6.35) 
= plkik-1) - p(kik-1) H'(k) + [ H(k) p(kik- JH '(k) +R(k)] H(k) p(kik-1) 
(6.36) 
Defining 
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W(k) = H(K) p(kik~ 1H '(k) +R(k) (6.37) 
K(k) = p(kIk-1) H"(k) W(k) (6.38) 
the recursion for the covariance p(kik) can be rewritten more compactly as 
p(kik) = [ 1 - K(k) H'(k)] pikik-1)] 
= p(kik-i) - K(k) W(k)H (k) (6.39) 
and the following identity can be written 
p(kik) H'(k) R(K) = ( p(kik-1JH'(k) - 
~ p(kik- JH '(k)IH(k) p(kik- 1H(k) #R(K}] (kK) p(kik- DH (kK )IR(K)" 
= p(kik-1)H (k)IH(k) p(kik- 1H (k) #R(k)] 7 
(H(k) p(kIk-1)JH"(k) + R(k) - H(k) p(kik- 1H (k)IR(K) = K(k) 


So, the Kalman fiiter gain given by (5.3), can be given by the alternate 


expression 

K(k) = p(kik) H'(k) R(k)” (6.40) 
Which in the case of HEA, for each site (node) it wiil take the form 

Kk) = p*{kik) Hk) R(k)” (6.41) 


and equation (5.5) will have the form | 

x? (kik) =X? (kik-1) + K%Xk) ( 2°%k)-H%(k)x? (kik-1)) (6.42) 
The recursion form for the inverse of the covariance update 9? (kik) is given 
by the equation 

p? (kik) =p? (kik- 1) + Hk)’ Rk) Hk) (6.43) 
The estimate x? (kik), using expression (6.41), (6.42) will be 
5? (kik) = 3° (kik-1) + p“(kik) HK)! AK) 24K)-HAK IRA KIK-1)) (6.44) 
Multiplying (6.43) by (6.44) yields for j=1,2 
p? (kik)? (kik) = (p? (kik-1)"' + Hk)” RAK) HAK)I X? (kik-1) 

+p! (kik) p'tkik) Hk)! Rk) ( 24k)-H4AK)R? (kik-1)) 


I1] 


=p? (KIK- 1) 4 (kik-1) + HK)" RK) 24k) (6.45) 

Thus 
Hk)’ RK)! 24k) = p4 (kik) "x4 (kik) - pd (kik- 1) X4 (kik-1) 
(6.46) and this will be used to eliminate the measurements from the 
combined 
estimation update equation which will be similar to (6.44) with the 
superscript ¢ instead of ], ie. 
X° (kik) = &° (kIK-1) © pCktk) H°(k)! RK) € 2°(K)-H(K)x° (Kik-1)) 
(6.47) 
Using (6.30), (6.31) and taking advantage of the dlock-diagonai form of 

(6.32), the combined state updating, given dv equation (6.47), can be 


rewritten as 


2 
x° (kik) = x° (kik-1) + p°(kik) >H%Xk)) RAK)” ( 2{K)-HAKIK? (KIK-1)) 
j=t 


(6.48) 


Similarly, the combined covariance update is similar to (6.41) with the 


superscript c instead of j, Le. 
o° (kik) = p* (Kik- 1) + Hk) Rk) HK) (6.49) 


* 


Similar to (6.48), (6.49) can be rewritten as 


, 
3° (kik =p? (kik-1) + SRM RAK AK) (6.50) 
§=1 


Multiplying (6.50) with (6.48) yields, after cancelations (similar to those in 
(6.45)) 
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2 
p° (kik) x° (kik) = p° (kIK-1) ®° (KIk-1) + DDHXk)" R(k) | Zk) (6.51) 
j=t 


Finally, substituting (6.46) into (6.51), one obtains 


=| 


p° (kik) x° (kik) = p° (kIk-1)_X° (KIk-1) 


-| 
Sil (kIk)” x? (kik) - p? (kik-1)7' X? (kik- I (6.52) 
j=l 
Which is the sought-after expression of the combined estimate in terms of 
only the local estimates. So, the fused track estimates combine the local 
track estimates and the incoming track estimates without having to calculate 


cross covariance given by (6.11), and it can be stated that the fused 


estimates is the global estimates for the tracks in the overlapping area. 
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VIT. KNOWLEDGE-BASED TRACK FUSION 


A. CAPTURING THE EXPERTIZE CF A HUMAN EXPERT 

In muititarget tracking we are concerned with the position of targets and 
their identity and behaviour. In fact, the position is of over-riding 
importance because identity and behaviour mean little unless they can be 
associated with position [Ref. 9]. Also, since we are concerned with a 
dynamic environment we need to take time into account. So, it would appear 
then that the first task with which we are faced is how to deal with 
Kinematic information. In order to combine track information from any two 
radar sensors in a network, these are compared to determine whether they 
pertain to the same target. The decision process is called correlation. As we 
mentioned before, we consider this decision process implicitly included in 
the fusion process, because there is no meaning of the fusion without it. In 
real life, radar sensors provide different types of information with different 
accuracies. A modern radar display includes alphanumeric characters and 
symbols for directly conveying additional information. This ts useful when 
target identity and altitude are to be displayed. The target track might be 
shown as a line on a synthetic display. The configuration of the line 
indicates the direction of the target path while its length can be made 
proportional to the target speed. This kind of display has a computer to 
generate the graphics and control the radar display. This permits 
magnification of a selected area, stored flight plans, stored clutter map and 


soon. The operator can communicate with the computer in an interactive 
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manner by means of a keyboard, track ball or light pen. Sometimes, an 
auxiliary display is mounted adjacent to the main display to provide tabular 
data that would otherwise encumber the main display [Ref. 15]. Current 
systems rely largly on manual correlations to form a coherent oicture of the 
underlying situation. An operator at the radar display makes a visual 
comparison of the information provided by two or more sensors and by 
applying his experience arrives at a decision. But, even with moderately 
complex scenarios, the workload can easily overwhelm the limited number 
of operators available and displays. This can lead to important information 
being overiooked. A computer program which couid reliably carry out a 
large fraction of this task would greatly assist the operation and 
performance of the entire system. The operators become proficient after a 
long time of practice. Discussions with former operators [Ref. 50], revealed 
that they acquired two things as they become experts. First, they 
memorized facts about the platforms operating in their area, the facilities 
available in the countries of the area and the political alliances of those 
countries. Secondly, they learned how to relate reports received to the 
above facts and the current situation in a way which would allow them to 
develop hypotheses abcut future platform motions and activities. 

Our initial approach to the multisensor information fusion was to search 
for suitable techniques from the world of Al which: 

!. Were weil defined. 
2. Had been demonstrated on a similar type of probiem. 

Perhaps the most well known and well defined part of the Al scene is expert 


systems. 
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With the arrival of expert systems , there is a great rush to encapsulate 
human expertise in computer software, and multisensor infor mation fusion 
and its related fields are obvious areas for attention. The expert system can 
be considered in a wide sense as an apoiication of artificiai intelligence to 
computer scftware. The philosophy of an expert system is to produce a 
computer solution to a problem by capturing the expertize of a human 
expert. So, it can emulate the performance of a human expert by 
incorporating the analytic and heuristic knowledge which the human expert 
has. Of the many expert systems that have been developed in the last 
decade, the majority of the successful programs were designed to play a role 
analogous to that of a human consuitant. Not surprisingly, this work was 
done in areas of Medicine, Cnemistry, and Geology in which there is an 
established tradition for consultation. Human consultants in these fields are 
valuable Decause they are specialists Who possess extensive knowledge 
about particular problem domains. 

Expert consultation systems have focused on problems in which a human 
expert's knowledge is largly factual in nature. Here, the Key to solving a 
problem lies more in knowing the relevant information than in ingeniously 
constructing a soiution from icgicai principies. The human expert is 
distinguished by knowing all of the factors that are important, and by 
processing judgment in combining diverse considerations to reach a decision. 
it follows that a corresconding @xper: system musi nave effective vays to 
represent and employ large amounts of different kinds of knowiedge bearing 
on specialized problems. Generaly, the expertise is in the form of rules, and 


these rules form the knowledge base of the system. Recently, expert 
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systems have been found effective in planning, monitoring, and 
interpretation tasks [Ref. 51]. Researches have applied this technology to a 
variety of military problems. For example, planning of aircraft missions [Ref. 
52], simulation of air battles [Ref. 53], and analysis of platforms operating in 
a certain area, and their location and the activity in which they are engaged. 
The symbolic nature of the information fusion problem and absence of a well 
developed approach to it, suggested that a system with rapid prototyping 
capabilities wouid be helpful [Ref. 50]. Some expert system shei!ls provide 
tools which make prototyping of data structure quick and the rules 
employed for reasoning easier to implement and modify than conventional 


programs. Figure 7.1, shows the general structure of an expert system. 


B. KNOWLEDGE REPRESENT ATION USING RULES 
Rules provide a formal way of representing recommendations, directives, 

or strategies. They are often appropriate when the domain knowledge 
results f rom empirical associations developed through years of experience 
solving problems in an area. Rules are expressed as IF - THEN statements, 
as shown below. 
IF: A is true 

and Bis true 

and Cis false 
THEN: conclude X 
This is a type of production rule which has the generai form [Ref. 43]: 
IF: logical conditions are satisfied 


THEN: take the indicated action 
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When the IF portion of arule is satisfied by the facts, the action specified 
by the THEN portion is performed. Among the potentially important assets 
of the production rules approach is that it provides the means of 
understanding how a decision was reached and is able to explain and correct 
erroneous conclusions. 

A controlling framework is used to allow the user to access the 
Knowledge base in the manner of a consuitation whereby the user may 
volunteer information or the machine may question the user until sufficient 
evidence is gathered to produce useful conclusions. The user may also ask 
the system to explain its reasoning so that he may understand its reasoning 
and undestand how the conclusions were reached. 

This method of problem solving was adopted as it seemed to fit the 
multisensor data fusion problem, assuming that the human expertise exists. 
However, most of the weil-publicised expert systems are in quite different 
problem domains to muitisensor information f usion. Examples being medical 
diagnosis, fault diagnosis and the well- known mineral prospecting expert 
system called PROSPECTOR. In this type of problem, it can be assumed that 
all symptoms belong to the same patient, whereas, in multisensor 
information fusion, there is the probiem of finding out which evidence 
belongs to which patients, and indeed how many patients are present. Also 
the multisensor information fusion problem is a continuous, real-time 
croblem, rather than a single shot diagnosis. 

The heart of an expert system is its corpus of knowledge [Ref. 54]. When 
Al scientists use the term “knowledge, they mean the information a 


computer program needs before it can behave intelligently. The Knowledge 
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in an expert system is organized in a way that separates the knowledge 
about the problem domain from the system's other knowledge, such as 
general knowledge about how to solve problems or knowledge about how to 
interact with the user. Several advantages accrue to this separation: 


The same knowledge can be used for more than one purpose. For 
example, a given knowledge dase can be used to solve a particular 
problem. to provide an explanation for the solution, or to support 
computer-aided insiruction about the problem. 


a. 


. The power of ihe program can de extended either by expanding the 
Knowledge base or by adding facilities to the interpreter. [n particular, 
this allows a large system to be developed incrementally. 


c. The problem-solving mechanisms and system facilities of the interpreter 
can be appited to simular prcolem domains by replacing the oid 
Knowledge base by a knowledge base for the new domain. 


Know ledge Base 


(Domain Knowledge) 


Inference Engine 
(General Problem- — 
Solving Knowledge) 





Figure 7.1. Generai Structure of 
an Expert System 


tei 


The collection of domain knowledge is called the” knowledge base’. while 
the general problem- solving Knowledge is called the “inference engine’. A 
software with Knowledge organized this way is called a “knowledge-based 
system. Virtually, all! expert systems are knowledge-based systems, while 


the converse is not necessarily true [Ref. 54]. 


EXPERT SYSTEM 


<nowledge Base | 








Facts 







Interpreter | Scheduler 


Inference Engine 


Figure 7.2. Structure of an Expert System 


As shown in frigure 7.Z, the knowiedge base in an expert system contains 
facts (data) and ruies that use those facts as the basis for decision making. 
The inference engine contains an interpreter that decides how to apply the 
rules to infer new knowledge and a scheduler that decides the order in 


which the rules should be applied. When the IF portion of a rule is satisfied 
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by the facts, the action specified by the THEN portion is performed. When 
this happens the rule is said to fire or execute [Ref. 55]. A rule interpreter 
compares the IF portions of rules with the facts and executes the rule whose 


IF portion matches the facts as shown in Figure 7.3. 


FACTS 


(3090) O00 






Match Execute 


fii! ooo 


RULES 


Figure 7.3. The Rule Interprets Cycles Through 
a Match-Execute Sequence 


C. INVOKING RULES IN A RULE-BASED SYSTEM 
There are two important ways in whica rules can be used and invoked in 
a rule-based system; one is called backward chaining and the other forward 
chaining. 
1. Backward Chaining 
Backward chaining is often described in terms of goal-directed 
reasoning or top-down reasoning. In backward chaining the system has a 


set of initial goals, and the rules are invoked in reverse order. The system 
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begins by examining a limited set of production rules, whose right-hand 
sides are the goals. The system then proceeds to examine the left-hand side 
of the rules to see which of the goals (RHS) are satisfied. As the rules are 
examined in this backward unraveling, some premises (of the left-hand side 
of rules) are unknown (logically unsatisfied) and therefore they become new 
subgoals. If a subgoal is unknown, a question may be asked to determine its 
Status. [ts strategy can be summarized in the following steps: 


(1) Find arule a "THEN" pattern that matches the goal. 
Found ------- Go to step 2. 
Not Found --- Fail. 


(2) Use the “IF” part of the rule to establish new sub-goal(s). 
(3) Find fact(s) that satisfies the new sub-goal(s). 
2. Forward Chaining 
In forward chaining the system does not start with any particular goais 

for it. That is, it has no initial subgroup of production rules which establish a 
starting point. Instead, the system starts with a subset of evidence and 
proceeds to invoke the production rules in a forward direction, continuing 
until no further production rules can be invoked. Its strategy can be 
summarized in the following steps: 


(1) Find arule with an “IP” pattern that matches a fact 
Found ---------- Go to step 2. 
Not Found ------ Fail to find a goal. 


(2) Assert the rules "THEN" clause, i.e add a new fact to the data base. 


(2) Does the new fact satisfy the goal? 
Yes ------------- we are successful, quit 
IN Go to step 1. 
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3. Backward Versus Forward Chaining 

Although several systems have been built emphasizing backward 
chaining, both forms of invocation and evaluation of the production rules are 
equally valid as long as they yieid the same correct conclusions. the rate of 
arriving at the conclusions will probably differ considerabiy depending on 
the strategy adopted. Most classification problems can be solved using 
either one of the approaches individuaily or a mixture for production rule 
evaluation. The shape of the problem space determines which is better. As 
shown in Figure 7.4, fan-in cails for forward chaining and fan-out calls for 
backward chaining. ihe bidirectional search is often favorable. Using it the 
forward chaining dDegins from the known facts and the backward chaining 


begins from the best hypothesis. 
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Figure 7.4. Fan-iN and Fan-Out Stages of Knowledge 
Aquisition 
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D. METAKNOWLEDGE AND EXPLANATION FACILITY 

An expert system has knowledge that lets it reason about its own 
operations plus a structure that simplifies this reasoning process. This 
knowledge the system has about how it reasons ts called “metaknowledge 
which just means knowledge about knowledge. Also, it is better to have what 
is called an “explanation facility". This is knowledge for explaining how the 


system arrived at its answer. 


E. BLACKBOARDS 

Blackboards refers to a particular AI problem solving methodology. The 
best known applications of the blackboard methodology are HEARSAY-II, a 
speech understanding system [Ref. 56], and the HASP/SIAP sonar data 
interpretation system (Ref. 57, 58].These applications effectively processed 
regular streams of data from a single sensor, treating any other information 
as locally static. But the blackboard methodology is more generally 
applicable. In particular, it provides a convenient framework for integrating 
maximaily reduced information from multiple sources with different 
temporal characteristics. 

The biackboard problem solving methodology originated approzimately 
10 years ago and has been evolving aren since [Ref. 59]. The main feature 
of a blackboard system is a global data store holding input data and 
hypotheses about the solution of the problem derived from that data. 
Related information is kept together. The global data store is known as the 
blackboard. 
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F. REPRESENTING UNCERTAINTY IN EXPERT SYSTEMS 

Expert systems are often forced to make judgements in the light of 
incomplete or unreliable data. The general problem of drawing inferences 
from uncertain or incomplete data has inspired a variety of technical 
approaches. Parade [Ref. 60] offers a review of different approximate 
reasoning techniques which have been proposed for dealing with uncertain 
or imprecise knowledge in expert systems. These tecniques can be 
Summarized as Bayesian mode!, Dempster-Shafer belief theory, fuzzy logics, 
and ad hoc approaches. 

1. Bayesian Modei 

One of the most useful results of probability theory is Bayes theorem, 

which provides a way of computing the probability of a particular event 
given some set of observation which is made. Let 
P(H;JE) = the probability that hypothesis H; is true given evidence E 


P(EIH;) = the probability that the evidence E is observed given that 
hypothesis 1 is true 


P(H;) = thea priori probability that hypothesis i is true in the absence of 
any specific evidence. These probabilities are called prior 
probabilities or priors. 


k = the number of possible hypotheses 


The theorem then states that 


K 
P(HIB) = P(EIH,) * P(H,) / > P(BIH,) * P(H,) (7.1) 


na 


126 


For a long time, the Bayesian model had been the only numerical 
approach to inference with uncertainty, since no quantification was 
introduced in the patterns of plausible reasoning. One of the best-developed 
uses of Bayes theorem for Al problems ts in the solution of pattern 
recognition or classification problems. Bayes theorem can be modified to 
handle a variety of more complicated situations. But there are several 
drawbacks to the use of Bayes theorem. I[t is often difficult to collect all the 
a prior! conditional and joint probabilities required. Doing so would require 
accumulating a great mass of data. Doing so would also be very expensive. 
But worse, the data would be obsolete by the time they were collected. It is 
very difficult to modify the database of a Bayesian svstem because of the 
large number of interactions between the various components of it. Also, 
evaluating Bayes formula to give an accurate estimate of the probability of a 
particular outcome must be disjoint. [t cannot ever happen that two of them 
occur at once. This is often not the case. The accuracy of Bayes’ formula aiso 
depends on the availability of a complete set of hypotheses. In other words, 
it must always be the case that one of the known hypotheses is true. For all 
of these reasons, Bayes theorem does not appear to solve problems that 
arise in uncertain reasoning in real-worid problems, although it does serve 
as the basis for some probabilistic Al systems, e.g., PROSPECTOR [Ref. 61]. 

2. Demoster-Shafer Theory 
Several mathematical modeis cf uncertainty, which depart from the 
usual probability approach, have been recently proposed, particulary, 
Dempster- Shafer belief theory (Ref. 62]. It is also called mathematical 


theory of evidence. A scheme for combining evidence which includes 


127 


uncertainty or ignorance was devised by Dempster and later formulated 
Within a flexible representation framework by Shafer. It is more general 
than either a Boolean or Bayesian approach, providing a formal method for 
integrating Knowledge derived from a variety of sources for use in 
perceptual reasoning. In this formalism, the iikelihood of a propostiion A; is 
represented as a subintervai, ([s(Aj), p(A;)], of the unit interval, 10, i]. The 
evidentiai support for proposition A; is represented by s(A;), while p(A;) 
represents its degree of plausibility, p(A;) can aiso be interpreted as the 
degree to which one fails to doubt A;, p(A;) being equal to one minus the 
evidential support of “A; (the symbol "~" is the Boolean NOT), ie., the 
plausibility is the complement of the suppert for ~A;. So, p(Aj) is 
o(A;) = 1 - s(~ Aj) 

The lower value, s(A;), represents the support for that proposition sets 
a minimum value for its likelihood. The upper value, p(A;), denotes the 
plausibility of that proposition and establishes its maximum likelihood. 
Support may be interpreted as the total positive effect a body of evidence 
has on a proposition, while plausibility represents the total extent to which a 
body of evidence jails to refute a proposition. The degree of uncertainty 
about the actual prooability value for a proposition correspond to the width 


of its interval. So, the “uncertainty of A;" Is: 


u(A;) = p(A;) 7 s{ A;) 
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Dempster’s rule of combination requires that the knowledge sources be 
independent. The representation involves the assignment by a knowledge 
source of “probability masses”. The mass allocated by a certain knowledge 
source to A; is denoted m(A;). To clarify, assume that there is a set of n 
mutually exclusive and exhaustive propositions, such as that the target is of 
type Ay,Ad, concen , A,. The method of evidential reasoning can assign a 
probability mass denoted as m(A;) to any of the original n propositions or to 
disjunctions of the propositions. For example, a disjunction is the proposition 
that the target is of type A, or Az (denoted as A, VA) and the mass 
assignment is denoted as m{A,; VA2). There are (2-1) such general 
propositions (including all the possible disjunctions) that may be assigned 
mass, and the masses summed over all of these propositions must equal 
unity. It is noticed that this 1s a more general form of representation differs 
from the standard Bayesian approach in which probabilities are assigned 
only to the original n propositions, disjunctions are not considered. The 
representation to uncertainty 6 is mass assignment to the disjunction of all 
the original propositions and is denoted by 

m(6) = m(A, VAdV............ VA,) (7.2) 

Finalty, mass can be assigned to the negation of a proposition. For 
example, the mass assigned to the negation of a A, (the target is not type A;) 
is denoted 

m(~A,;) = mM(AxVA2 Vi VA,) sao) 
The support s(A,) for the basic proposition that the target type is A, is just 
the mass associated with A,(s(A,) = m(A,)). For a more complex proposition 


such as that the target is either type A,, Az or A3, is expressed as 
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S(A;VA2VA3) = m(A;) + m(Ag) + m(A3z) + m(A; VA2) + m(A, VA3) 
* m(A>VA3) + (Ay VAgVA3) (7.4) 

The plausibility of a given proposition as mentioned before, is the sum of all 
masses not assigned to its negation. Alternatively, p(A;) can be computed by 
summing all masses associated with A, and all disjunctions, including 9, that 
contain A;. For exampie, 

p(A,) = m(A,) + m(Ay VAd9) + ere + m(@) (Jaa 

The use of these Shafer-Dempster techniques as they are Known 
appears more complex than the use of the simple Bayesian process with its 
single set of probabilities and one of the difficulties in pursuing such an 
approach is to determine whether the extra complerity is justified by the 
results which can be expected. It is important to remember that an operator 
may have to make decisions based on the outcome of the identity process 
[Ref. 63]. We can easily see that an output such as, for example, “ the 
probability that the detected aircraft is an enemy is at least 30% and could 
be 70% "seems more likely confuse than to clarify. 

3. Fuzzy Logic 

The objective of fuzzy logic is to modify (or “fuzzify”) logic so that it 
applies directly to informal arguments. Fuzzy logic results from two stages 
of “fuzzification’: 


a. The introduction of vague predicates into the object language. This 
result in some form of multivalued logic. 


b. Treating the metalinguistic predicates “true” and ‘false’ as themselves 
vague or fuzzy. 


The second stage is by far the most radical and controversial. Fuzzy logics 


have been imported into AI to deal with areas of vagueness and incomplete 
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information. Most expert systems, for example, are forced to take decisions 
when not all the facts pertaining to the decision are available. In such 
contexts it is natural to employ logics which, unlike classical logic, are suited 
to reasoning With such incomplete information. Non-monotonic logic has also 
been developed, largly by the AI fraternity itself, to deal with reasoning 
with incomplete information. Moreover, many concepts employed in natural 
language and AI are claimed to be ‘vague’, and the necessily of reasoning 
with such concepts suggests that some logic of vagueness is appropriate 
(Ref. 64]. For example, the concept “young”, it may be said that people 
under i0 years of age are young and those above 60 years are not young. 
However, there is no particular day at which a person's age switches from 
‘young to ‘not young , rather, this is a gradual transition. In fuzzy logic, the 
concept of young is expressed by a ‘membership function” representing the 
degree to which a person of a particular age can be considered to be young. 
It should be said that many applications of fuzzy logic are both 
philosophically and practically controversial, and the whole area is, at 
present, controversial. . 

Zadeh offers two main reasons for adopting fuzzy logic [Ref. 65,66). 
First, he claims that it avoids the complexities introduced by regimentation 
of informal argument; secondly, he claims that it is the proper way to 
acknowledge that true and false’ are not precise but fuzzy. 

In Fuzzy Logic (FL) the set of truth-vaiues of the base logic, the set of 
points in the intervai (0,11, is replaced by fuzzy subsets of that set. Zadeh 
does not, however, allow all fuzzy subsets. This, it is claimed, would result in 


‘unmanageable compilerity. Instead, Zadeh empioys only a countable and 
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structured set of fuzzy subsets of [0,1] referred to as “linguistic truth- 
values”. More explicitly, the Truth- Values (TV) set of FL is assumed to be a 
countable set, TV, of the form 
TV = (true false, not true, very true, not very true, 

more or jess true, rather true, nol very true, 

not very faise........... } (7.6) 
Each element of this set represents a fuzzy sudset of (0,1j. Moreover, each 
element of TV is generated from the fuzzy set denoted by the term rue. 


So, for example, if U,-y.1s the membership function of the fuzzy subset irue, 


then the membDersnip functions for the other members of TY might be given 


as follows: 
Uraisel V) = Uteueli- v) (7 aa 
Ureerrue) 1 - Usual t) (7.8) 
Uveryinaat)) = (Ureye( v))? (7.9) 
Urathertrue(Y) = (Urruel v))1/2 | (7.10) 


etc. where vis thef UzZy variable. So that once the meaning of true, and 
the rules of computation are fixed, then so is the meaning of all the members 
of TV. Asa consequence. the meaning of the linguistic iruth-values (that is, 
the fuzzy suDsets ihey denote) is cruciaily dependent upon the meaning 
chosen for true’. Moreover, it is quite difficult to see such a choice as 
anything other than arbitrary. Zadeh hints that the choice is motivated bv 
ine specific area of discourse under consideration. Consequently, the 


Meanings assigned io ihe linguistic truth-values are iccalised. 
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How are the logical constants ~ , & , V and — is used to obtain their 


meanings in a regime where truth values are elements of TV? As afirst 


step we might proceed as follows: 


[~A] (v) - ‘| (Al (v)) (7.11) 
[A & B} (v) - [A] (v) A [BI (v) ea 
[A VB] (v) = [A] (v) V IB] (v) (7.13) 
[A > B] (v) - {Al (v) = [B] (v) (7.14) 


where the connectives ~, &.V, | , Aand + are those of the base logic 


and each [A] denotes a fuzzy subset of [0,1] represented above by its 
membership function. But there is a problem with this way of orcceeding. 
We want each sentence in the language to denote not just an arbitrary fuzzy 
subset of [0,1] but rather an element of TV. Unfortunately, the above 
semantics offers no guarantee of this. Zadeh circumvents this difficulty by 
introducing the notion of a “Linguistic Approximation” (LA). Each fuzzy 
subset A of [0,1] has associated with it an element A* of TV, it is called 
Linguistic Approximation (LA). This is expressed as 
A* = LA(A). (7.15) 

Unfortunately, there is not an obvious candidate for the notion of ‘best’ of 
such approximation. nor a general technique for computing ‘gcod' ones. But 
whatever the merits of this notion, Zadeh employs it to provide the meanings 
of the logical constants as follows: 

[~A] (v) LA( dv. | ([Al (v))) (7.16) 

[A & B) (uv) LA( Avi{TA] (v) A[B) (v))) (7.17) 

[A VB} (v) = LAC Av {({A] (v) V(BI}(v))) (7.18) 

[A + B) (v) - LACAvALA] (v) 5 [B}(v))) (7.19) 
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Now, the functions [A] and [B] associate with each sentence an element of TV, 
the set of fuzzy truth-values. 

The introduction of fuzzy truth-values paves the way for a rather 
radical approach to inference. According to Zadeh, inference is only 
‘approximate’. Zadeh illustrates his notion of approximate reasoning by 
reference to examples of the form 


ais small 
a and b are approximately equal 


b is more or less small 
To illustrate, consider the statement 

ais smail 
Under the administration of ciassical logic this proposition would be 
rendered true just in case a belongs to the set which constitutes the 
extention of the predicate small. In fuzzy logic, however, things are 
somewhat more involved. The predicate small is fuzzy, and proposition “a is 
small" is interpreted as the assignment of a fuzzy predicate as the value of a 
variable which corresponds to an implied attribute of a. More explicitly, this 
proposition would be interpreted as the assignment equation 

Height(a) = small 
where “Height” is the implied attribute. In equational terms the second 
premise of our example would be rendered as 

(Height(a), Height(b)) = approximately equal 

where the right-hand side represents a fuzzy subset of [0,1] x (0,1). 


In general, then, a proposition of the form 


is rendered as the assignment equation 
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(ay. eee ,a,) =C 
The premises of our examole thus constitute a pair of assignment equations 
of the form 
a= small 
(a,b) = approrimately equal 
and, in generai, a coilection of propositions (ai\................ ai,) is Ci, 0 i Sa-! 


yield a set of equations 
WE ritircesc..- , aig) = Ci 0 Sié¢n-! (7.20) 
For Zadeh, approximate inference amounts to solving such systems of 
equations. As with equations in ordinary algebra, we can solve for any of 
the variables involved in the equations. As an illustration, solving for b in 
our example yields: 
b = LAl[small ° approximately equal], 
where ° is the composition of fuzzy relations, and is given by 
Usmali ° approximately equai(D) = 
V Wamast() WEN eroximecety equai(%. D)! (WAZ) 


where VY represents the supremum over ail objects in the domain of the 
x 


fuzzy predicate smail”. 

intuitively, the composition of the predicate “smail” and the binary 
relation “approximately equai” represents the fuzzy predicate which returns 
that value which represents the best fit, between those objects which are in 


the domain of small, and which are approximately the same height as b. 
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According to Zadeh, the consequence of a given set of premises depends in 
an essential Way on the meaning attached to the fuzzy sets which appear in 
the premises. This is, apparently, a consequence of the focal character of 
fuzzy TY's. Consequently, validity can only be characterised semantically, 
and the traditional notions of completeness and consistency are peripheral to 
fuzzy logic. 

In the light of the features of fuzzy logic, it would seem that it lacks 
the precise formal ruies of inference in addition to the absence and apparent 
irrelevance of consistency and completeness results and the employment of 
a philosophically suspect theory of truth. Ail these, engender a feeling of 
insecurity. Indeed, as Haak points out (Ref. 67], fuzzy logic seems hardly 
recognisable as a logic at all. Probably, the best defence of fuzzy logic is 
located not in its conceptual foundations but in its potential applications 
(Ref. 68]. After all, many formal frameworks have been employed with 
much success even though their conceptual foundations have been in a sorry 
state. 

4. Ad hoc Approaches 

Many researchers in artificial intelligence have felt a need for 
alternatives of the standard Bayesian approach and have proposed and used, 
generally with success, more empirical models, particularly in expert 
systems such as MYCIN [Ref. 69], and others [Ref. 70,71]. Also many expert 
systems employ some form of numerical assignments to assertions which are 
often combined in ways which suggest that such assignments behave 


mathematically like probabilities. 
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One of the earliest approaches to reasoning with uncertainty was 
incorporated into the MYCIN system [Ref. 69]. It introduced a notion of “ 
approximate implication” using numbers called ° certainty factors” which 
were used to indicate the strength of a heuristic rule. For example, MYCIN’s 
knowledge base includes the rule: 

IF The infection is primary-bacteremia and the site of the culture is 
one of the sterile sites and the suspected portal of entry of the 
organism is the gastro-intestinal tract. 

THEN There is suggestive evidence (.7) that the identity of the organism 
is bacteroides. 

The number e is the certainty factor (in the range 0 to |) of the 
conciusion. In MYCIN, assertions are not just true or false, the reasoning is 
vague or inexact and is indicated on a numerical scale. MYCIN's conjunction 
operator performs a minimisation, and its disjunction is furnished with a 
Bayesian interpretation. To elaborate, all assertions being considered by 
MYCIN have associated with them two numbers, a Measure of Belief (MB) 
and a Measure of Disbelief (MD). The MB of a hypothesis h given evidence e 
is the proportionate decrease in disbelief in h, and can be thought of in terms 
of probabilities as 

l if P(h) = 1 
MB{h.e] »{ (maxiP(hie) P(h)) - P(h))/( maxi 1,0] - P(H)) otherwise (7.22) 
Similarty, the MD is the proportionate decrease in belief in h as a result of e 
l . if PC h) = 0 
MD{h,e] ~ { (mintPthie) Pin)! - P(h))/(min(1,0! - P(H)) otherwise (7.23) 
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A particular piece of evidence either increases the probability of h, in which 
case MB(h,e) > 0 and MD(h,e) = 0 (i.e., there is no reason to disbelieve h), or it 
decreases the probability of h, in which case MD(h,e) > 0 and MB(h.e) = 0. 
This relationship can be seen from the above formulas for MB and MD. 

From these two measures, an overall estimate of the confidence of the 
system in its belief about the hypothesis can be computed. This estimate is 
called the Certainty Factor (CF) and is given as 

CF{h,e] = MBth.ej - MD{h.e] (7.24) 
It 1s noticed that if CF is positive, the system believes that the hypothesis is 
true; if CF is negative, there is more evidence against it and the system 
believes it to be faise. By separaling this measure into the two components 
MB and MD, the problem of siight confirmatory evidence being interpreted 
as disconfir mation is avoided. Considering several pieces of evidence, the 
measures of belief and disbelief of a hypothesis given two observations s, 


and so are computed by: 


0 if MD{h.s;&s2] = 1 
MBih,s,&s4] -{ vpin.s) + MB(h.sy)*(1-MBih.s; }) otherwise (72>) 

0 if MB(h.3; és] =] 
MDih,s;&s>] ~{upias)) + MD{h.so]*(1-MD{h.s, 1) otherwise (7.26) 


One way to state these formulas in English is that the measure of belief 
in h is 0 if h is disbelieved with certainty. Otherwise, the measure of belief 
in h given two observations is the measure of belief given only one 
observation plus some increment for the second observation. This increment 


is computed by first taking the difference between !| (certainty) and the 
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belief given only the first observation. This difference is the most that can 
be added by the second observation. The difference is then scaled by the 
belief in h given only the second observation. A corresponding explanation 
can be given, then, for the formula for computing disbelief. From MB and 
MD, CF can be computed. These formulas meet several requirements that 
one might wish them to satisfy, including commutativity, the order in which 
a set of observations is made is irrelevant. 

A simple example will show how these functions operate. Suppose that 


an initial observation has been done that confirms our belief in h with 
MB-=0.3. Then MDfh,e]=0 and CF(h,s;)=0.3. Now a second observation has 


been done, which also confirms h, with MB(h,s2)=0.2. Now 

MBih,s;&s9] = 0.3 + 0.2*0.7 = 0.44 

MDth,s, &s4] = 0 

CF{h,s;&s2] = 0.44 
From this example it can be seen how slight confirmatory evidence can 
accumulate to produce increasingly larger certainty factors. 

Sometimes it may be necessary to consider the certainty factor of a 
combination of hypotheses. It can be computed from the MB and MD of the 
combination. The formulas MYCIN uses for the MB of the conjunction and 
the disjunction of two hypotheses are 

MB(h,&h>,e}] = min(MB(h;,e], MB{h,e]) (7.27) 
MB{h, or ho,e] = max(MB(h,,e], MB[h..e]) (7.28) 
MD can be computed analogously. 
From tactical intelligence, the advantage of employing deter ministic 


values instead of probabilities is often called for. For instance, an enemy will 
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most likely make a maximum g terminal maneuver rather than the average 
from a Monte Carlo simulation of all possible maneuvers. This tactical 
doctrine may prescribe a precise maneuver. Also, for very good reasons, 
people often feel uncomfortable estimating prior probabilities [Ref. 72]. Yet, 
they are willing to say whether a piece of evidence increases or decreases 
the probability of a hypothesis with respect to its prior value, and are often 
willing to use the certainty value to estimate the amount of change. Thus, 
certainties are particularly useful as a technique for talking about relative 
probabilities. In addition, they seem more natural than probabilities when 
establishing the context for a hypothesis. 

By contrast to probability theory, these ad hoc approaches provide the 
expert with a language for more directly specifying how degrees of belief 
(expressed as subjective probabilities) are to be computed. The language 
does impose some constraints. It requires that functions for computing 
probabilities be composed out of small number of primitive functions. 
However, it also provides considerable freedom, such as allowing the 
specification of any loop-free network topology desired to group factors and 
control the flow of information. The price paid for this freedom ts that there 
is No longer any guarantee that all of the axioms of probability theory wiil be 
honored. However, if one views the values computed as heuristic measures 
of degree of belief, then the only question is whether or not it 1s easy to 
construct an inference network that adequately approximates the 
specifications of the expert. A commonly voiced criticism of such approaches 
is that they are unnecessarily ad hoc. It is claimed that there are alternative 


approaches available which are better documented and understood [Ref. 72]. 
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Mamdari and Efstathion [Ref. 73] for example, claim that fuzzy logic itself 
would provide more secure foundation for the enterprise. As a matter of 
fact, PROSPECTOR already employs some form of fuzzy-sets theory, at least 
according to the recent account given by Gaschning [Ref. 61]. 

Generally, it ts hard to quantify and mathematically relate such 
subjective parameters as partial ECM, intelligence levels, the threat and 
human experience. So, it is adequate and easy to use ad hoc approaches to 


approximate the specifications of the expert. 


G. EXPERT SYSTEM DEVELOPMENT TOOLS 

It is important to distinguish between expert systems and expert system 
development tools. As shown in Figure 7.1, expert systems are specific 
applications consisting of a Knowledge domain and an inference engine. A 
knowledge domain is generally the human expertize on a particular subject. 
The inference engine is the reasoning software. To obtain advice from an 
expert system, the user poses a problem via a user interface. The inference 
engine accepts the request, reasons about the query and the knowledge 
stored in the knowledge domain, and responds to the user. Expert systems 
can be used to provide expert advice and solve problems using a given 
knowledge domain. When a user presents a particular problem to the expert 
system, it uses the available reasoning knowledge to infer some advice, 
which it then reports to the user. | 

An expert system development tool can take the form of an Artificial 
Intelligence (AI) language such as Lisp or Prolog, an expert system shell, or 
an integrated artificial intelligence environment. Shells, a higher level of 


development tool, facilitate the development of expert systems by providing 
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a generalised inference engine and the ability to create knowledge domains 
in any subject area. An integrated expert system environment provides all 
the capabilities of a shell as well as other tools, such as decision support 
software. Expert system shells or environments (shell supersets) that 
support rule representation consist of a rule set editor (also known as arule 
set manager), an inference engine, and generally, a user interface. Actually, 
the user interface and the rule editor can be embeded in the inference 
engine. The developer of an expert system uses arule set editor to write 
rules. The inference engine uses the contents of the knowledge domain to 


arrive at its solution or recommendation. 


H. PAIRWISE CORRELATION FOR TRACK FUSION 

Track fusion is a difficult process and numerous algorithms have been 
defined for track correlation [Ref. 47, 63, 74, 75, 76, 77]. Many of these rely 
on probabilities to combine evidence, while others make hard yes or no 
decision. Because of the diversity of sensors that are operating in a large 
area surveillance system, the state vector coordinate system where the 
sensor/node feve! multitarget tracking problem is resolved will differ for the 
various local-track data bases. Assuming that the required coordinate 
transfor mation at each node is done using the appropiate transfor mation 
algorithm, the information collected by each node is overiaid in a common 
coordinate system. Furthermore, the time points at which the target states 
(latitude, longitude, etc.) are estimated may not coincide. Before fusing any 
two tracks, they are referred to a common time instant by using the 


prediction equations of the Kalman filter [Ref. 22]. 


142 


Following Lakin and Miles [Ref. 9], we adopted pairwise correlations for 
track fusion, Figure 7.5, shows the steps used in pairwise correlations to 
solve the correlation ambiguity, which involves 3 distinct rule-driven steps : 


1. First, assume all tracks (local and incoming) available at each node are 
separate and each track implies a new target. 


2. Second, apply rules which create the possible pairwise correlations 
between each incoming track and existing local tracks. Those fail the 
pairwise correlations are considered new tracks for targets beyond the 
coverage of local sensor/sensors. 


3. Third, apply rules to confirm strong correlations and to deny others. 
Where alternatives are of similar strengths, wait for further evidence. 
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FIGURE 7.5. Pairwise Correlation for Track Fusion 
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The correlation process is basically based on the position and velocity 
closeness of each two tracks. The next logical step is to combine the 
correlated tracks to get the best estimate. A straightforward and a fairly 
obvious approach is taking a weighted average with most weight being given 
to the most accurate sensor. Another approach is using one track from a 
correlated pair or group (one which is belived the most accurate) as a 
representative track so that the other tracks are filtered out. One of the 
primary reasons for using this approach is that it serves the immediate 
purpose. If the accuracy availiable from a single sensor is sufficient to satisfy 
the needed requirements, then it is sensible to use it. 

AS it is mentioned before, the positional correiation process is a 
prerequisite for the fusion of identity and behavioural information. As 
noted earlier these types of information are of little practical use unless they 
are associated with position. When we correlate kinematic information we 
deal with dimensional data to which we can apply recognized mathematical 
tests for correlation. However, identity and behaviour cannot be treated the 
same way. Expert systems can be used, in which inference is performed 
using both sensor data and rules. Their structure allows the utilization of 
fully different kinds of information regardless of its form. [his means that 
each information source 1s allowed to contribute infor mation at its own level 
of detail. They process heuristic knowledge, apply logical inference, and 
reason with the human knowledge stored in the computer. Rather than 
facts, this knowledge represents the human rules of thumb stored non- 
procedurally in the Knowledge domain. Like humans they can reason about 


uncertain situations, factoring degrees of uncertainty into the reasoning 
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process. Certainty factors can be assigned and carried throughout the 


reasoning process, then reflected in the advice the expert system derives. 
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VIII. THE SIMULATION SCENARIO 


A. EXPERTS’ VIEW OF MODERN RADAR ENVIRONMENT 

Technically, computers are concerned only with those radar signals which 
relate to responses from aircrafts, and it is therefore unnecessary and 
uneconomic to feed them with all of the unwanted echoes which occur as a 
radar antenna sweeps througn 360°, out to the range of its transmitted 
power. To be able to achieve this situation the radar signals of the 
concerned targets require to be converted into a digitised format. In this 
form the radar signals, radar data, or radar information can be fed into a 
computer, to be either displayed directly onto a radar display cr, if the 
computer has the capacity or is linked to an additional computer containing 
the relevant flight plans and information, then both types of information can 
be correlated before being further processed onto the operator's display. A 
further key factor in this correlation, is the allocation of identity codes to 
individual aircrafts, through the use of Identification of Friend or Foe (IFF) 
for military aircrafts, or a Secondary Surveillance Radar (SSR) for civilian 
aircrafts. Also, there is the ability to enabies those aircrafts which do not 
carry a transponder (SSR or IFF) to appear on the operator's display with a 
computer-related indication of their identity. 

By allocating to the concerned aircraft a discrete [FF or SSR code, and also 
by informing the computer that the code so allocated refers to the specific 


flight infor mation relevant to the aircraft, the computer is able to recognize 
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the radar information which it receives, and to correlate this information 
with the flight information already in its possession. The act of relating | 
flight information and radar information begins to open up wide horizons for 
the application of automation to the tasks of controlling the air space. The 
operator himself acts as a communicator, a navigator, a calculator and a 
predictor of future events. It is essential to recognise that the advantages in 
automation are in reducing the workload upon the operator and be applied 
primariiy to those of the operator's functions which limit his capability to 
discharge his primary responsibility, which is that of a decision-maker. 

As an example of the standard format of the type of information of the 
flight plan which are in general use are: 

1. Aircraft type; 

. Aircraft callsign; 
. SSR or IFF code; 
. Aerodrome of departure; 
. The aerodome of destination; 
. The proposed route of flight: 
. Estimated Departure Time (EDT); 
. The estimated time at the Flight Information Region (FIR) boundaries: 


Oo co ns HK Ws Bf WW AD 


. Height or desired cruising level: 

10. Aircraft's cruising speed; 

11. Type of flight (e.g. military/scheduied/general aviation): 

The radar viewing units have also changed dramatically from the original 


cathode ray tube. It is usual, in modern radar units to which automation is 
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being applied, to use a synthetic type of radar display. A modern radar 
display console, adds the following facilities to the conventional radars: 


a. Position symbols and labels adjacent to position symbols of selected 
aircrafts displaying important flight plan infor mation. 


b. Trail dots, which appear behind the aircraft's symbol to indicate the 
track which it has been foilowing. 


c. Visual alarms for an aircraft emergency, special hi-jack code, or radio 
faliure, these are in the form of flashing symbols and labels. 


d. Tabular areas, these are areas upon which can be displayed any 
information of interrst to the operator. 


e. Synthetic map displays, such as the outline of airways, and air-routes, 
the coast lines, danger areas, etc. These maps are usually programmed 
within the consol’s computer memory. Also there are facilities which 
exist for the operator to draw-in on his display a synthetic map for any 
special purpose, such as, for example, a military exercise area or a 
temporary prohibited area for an air display. 


Figure 8.1, provides some idea of the type of information which can be 
presented on TWS radar displays as applied to modern ATC systems [Ref. 
78, 79, 80,81]. For example, for satisfying the requirements of modern ATC 
systems, which must have instantly available information that is both 
accurate and reliable, the aircraft itself is able to co-operate with the ground 
based radar systems. That is, it can carry its own airborne equipment, 
known as a transponder’, which is capable of communicating with the 
ground-based SSR system. The transponder is activated by pairs of pulses 
transmitied by a ground interrogator, and its reaction is to transmit a train 
of pulses on a different radio frequency to the SSR interrogator receiver on 
the ground. Because the transponder is not relying upon reflected energy 


from the aircraft to provide a radar echo, but is making a full-blooded reply 
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itself, this enables the transmitters on the ground to be of lower power and 
employ simpler and cheaper technology and also ensure a certainty of signal 
return, unaffected by weather or other clutter factors. Also the returning 
train of pulses from the aircraft can be coded to contain infor mation 
pertinent to that specific aircraft such as, for example, the identity of the 
aircraft and the height at which it is flying. This factor gives the SSR 
receiver and its computer processor the ability to separate and identify 
different targets in a manner that the ordinary radar cannot do, and then be 
able to compute additional information such as the speed of the aircraft and 
its flight attitude, all without recourse to any radio telophony speech with 
the pilot, other than an initial request to select a special group of code 


numerals on his SSR select panel in the cock pit. 
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Figure 8.1. Modern ATC cisolay with SSR Information 


B. THE SCENARIO 

The HEA approach is going to be applied on three different TWS systems 
A,B, and C. These systems are assumed to be tied together by appropriate 
direct communication links as shown in Figure 8.2. Each system has detected 
two different targets using its own radar sensor. The local data of each 
system gathered by its own radar sensor have been processed using its local 
estimation process, resulting in two weil confirmed and distinct tracks. So, 
six tracks will result from the local estimators of the three TWS systems. 
These tracks are Al, A2, BI, B2, Cl, and C2 from TWS systems A, B, and C 
respectively. The corresponding targets for these tracks are al, a2, bl, b2, 
cl, and c2 for ace Al, A2, B1, B2, Cl, and C2 respectively. Using Equation 


(2.3), the network shown in Figure 8.2, is represented as 


G = (V, E) 
where V = (A,B, C) 
and E = ((A, B], [A, Cl}, [B, Cl ) 


The TWS systems together are assumed to cover a large air-space area 
with a partially overlapping fields of view. Each system is going to use 
locally its track information resulting from its local estimator (as that 
discussed in Chapter V), in addition to sending it to the the other two 
systems via the communication link used to tie each of the two other 
systems with the local one. By this way the area of coverage of each system 
is extended to cover the whole area covered by the three systems. This 
means that each system may get track infor mation pertaining targets 
beyond the coverage of its local radar sensor. This can give the operator in 


each system's site an advance details on aircrafts which are due to enter his 
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sector of responsibility which seems to be of great help especially in ATC 
systems and C3 systems. It is assumed that the suitable network access 
protocol which secure error free exchange of track information is used, and 
the needed coordinate transformation and the referring to the common time 
instant as discussed in Chapter IV is done. 

It is also assumed that the type of modern radar display console like that 
shown in Figure 8.1, is used at each TWS system. The fusion process is going 
to be performed in I WS system A based on its local track information and 
the other track information sent to it from TWS systems B and C. A pairwise 
correlation process is used to correlate each of the tracks Al, and A2 with 
- the other tracks Bl, B2, Cl, and C2. The correlation process is going to be 
based on the kinematic information of the last report of each track (range, 
bearing and speed), in addition to its identity code, intent and behaviour. A | 
simplified expert system approach as outlined in Chapter VII, using EXSYS 
expert system development package is used to perform the fusion process. 
The correlation process (embeded in the fusion process) will be basically 
Started based on the position and velocity closeness of each two tracks by 
thresholding the absolute value of the difference between their position and 
velocity to a certain threshold value. This threshold value could be chosen 
based on the error covariance. 

Two expert systems, TRAFUS! and TRAFUS2 are developed. TRAFUS! ts 
a kind of an experimental hard decision knowledge-based track fusion 
approach. TRAFUSZ ts a kind of an experimental soft decision knowledge- 
based track fusion approach. In these expert systems, simple inference rules 


are used to perform the correlation process and eliminate obviously 
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impossible pairing of tracks. The rules are allowed to be easily modified, 
added or deleted. New rules entered can be checked against the existing 
cules for consistency. 

TRAFUS1 and TRAFUSZ obtain data needed to make a decision by asking 
the user questions relevant to the tracks needed to be fused. The user can 
also ask how the expert system reaches a decision. These two features are 
very helpful in training novice operators in real life applications. Almost no 
training is required torun any of them or any already developed expert 
system using EXSYS expert system development package. Details of 
TRAFUS! and TRAFUS2 are presented in Chapter IX and Chapter X 
respectively. Their rules are described in Appendix E and Appendix F 


respectively. 
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IX. TRAFUS 1 


A. RUNNING TRAFUS 1 

TRAFUS( from TRAck FUSion), refers to an experimental system to 
explore the applicability of artificial intelligence techniques to the 
implementation of an automated, extremely flexible track fusion consultant. 
To run TRAFUS1, the user enters EXSYS TRAFUS1 or just EXSYS and he will 
be asked for the filename which will be TRAFUS1. If TRAFUS1 is on other 
than the default drive, then he should enter the drive designator with the 
filename. For example, EXSYS B:TRAFUS1. Then he will be asked if he 
wishes instructions on how to use the program. After that he selects if he 
wishes to have rules displayed as the program runs. Then he will be asked 
questions relevant to the subject. The user answers by selecting one or more 
answers from a list or entering a numeric value. The expert system will 
continue to ask questions until it has reached a conclusion. The conclusion 
may be the selection of a single solution or a list of possible solutions 
arranged in order of likelihood. TRAFUS1 can explain, in English, how it 
arrived at its conciusion and why. If possible, the program will derive 
information from other rules rather than asking the user. This ability to 
derive information allows the program to combine many small pieces of 
knowledge to arrive at logical conclusions about complex problems. The 
rules editor of EXSYS allows the rules to be easily modified, added or deleted. 
All knowledge base files for TRAFUS1 are kept in two parts: one with a RUL 


filename extension and one with a TXT filename extension. Both must be on 
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will start asking the user questions relevant to the subject area of the 
Knowledge base. This is how the program obtains the data needed to make a 
decision. There are two types of questions he may be asked: multiple choice 
and numeric value. 

Multiple choice questions will display a statement ending in a Verb, 
followed by a numbered list of possible completions of the sentence. The 
user shouid enter the number or numbers of the choices correct for his 
situation and press the [ENTER] key. If more than one number is chosen, the 
numbers should be separated with a space or acomma. If numbers outside 
the range of the list are entered. the program will re-ask the question. In 
fact the user wont gel past the question until he answers it. 

The other type of information the user may be asked for is a numeric 
value. There wil be an explanation of what information the program needs 
and a space to inter the value by typing it and pressing [ENTER]. The 
number can include a decimal point. 

The expert system will continue asking questions. When the program has 
obtained enough information to determine that all the IF conditions in a rule 
are true, it will display the rule, (unless the user has opted to not have rules 
displayed as they are used). If the computer determines that any of the IF 
conditions in arule are false, it will reject the rule and go to the next 
appropriate rule. An example of the results obtained from arun of TRAFUS1 


iS presented in Figure 9.1. 
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B. ASKING ABOUT RULES 


When a rule is displayed the user has the option of asking how TRAFUS1 


knows a condition in the IF part is true. To do this he enters the line 


number of the IF condition. The expert system will respond with one of four 


responses: 


1. 


3 


The expert system will display the rule or rules that allowed it to derive 
the information. A rule used for derivation wiil have information about 
the condition the user are asking about in its THEN part. He can then 
conlinue asking how the expert system Knew that rule's IF conditions 
were true and soon. /f ihe user asks about a condition that is an 
algebraic expression, the values of each of the variables in the 
expression wiil be displayed. He may then asks how these values were 
derived 5vy entering the number of the variabie. 


. If the user asks the expert sysiem how ‘tt knows a condition ts true 


that it did not derive, but determined by asking him for input, it will 
respond that he told it the information was true. 


The user can ask for information about a condition that is several 
conditions down in the list and which the expert system may not have 
yet tested. This can occur when the user asks the expert system WHY in 
response to its question. [f this 1s the case, the program will respond 
that it does not yet Know if the condition is true or not. 


In certain situations where the expert system has just derived new 
information, it may tell the user that the condition he is asking about ts 
false and the cule vul de eliminated. 


Rules may nave references for the source of the knowledge ( e.g. personal 


observation, book, article, etc.). If, when a rule is displayed, the user presses 


[R] the expert system vill dispiay the reference for the rule if it has one. 


When the user are finished examining the ruie, Dy oressing [ENTER!, the 


expert system will continue asking him questions. 
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C. USING "WHY" 

If the user wonders why the expert system needs to know the 
infor mation it is requesting, he can ask it by typing WHY, instead of making 
a selection from the list of values, and presses the [ENTER] key. The expert 
system will respond by displaying the rule it is trying to determine the 
validity of. He may now ask the expert system about the IF conditions or 
references as described before. Then he presses [ENTER] when he is finished 
examining the rule. The expert system may now have the question 
originally asked redisplayed or it may display another rule. If the later is 
the case, it is because the first rule displayed was being used only to derive 
information needed by the second, and the second is the rule actually being 
| tested. TRAFUS! will continue showing the rules it is using to derive 
information until it reaches the base rule it is trying to apply. This rule will 
have at least one choice in its THEN part. By pressing the [ENTER] key, the 
program will be continued. If more than one rule was displayed, each time 
the user presses [ENTER] he will go one rule up the list being used in the 
derivation. He will then be reasked the question he responded to with 
“WHY”. 


D. ASKING HOW A CONCLUSION WAS REACHED 

The user can ask the expert system how it arrived at its final value for a 
specific choice or why a statement is displayed. If he enters the line number 
for any choice or statement, TRAFUS1 wiil respond by displaying all of the 
rules it used to determine the value of that choice or statement. He again 
has all of the options in requesting more information about each of the rules 


as discussed above. If he wishes to learn why a choice not displayed was 
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eliminated by being given a probability value of 0, he presses [A] to have all 


choices displayed. Then he enters the line number of the choice in question. 


E. CHANGING, RERUNNING AND PRINTING THE DATA 

The user can easily test and analyze the effect his input had on the final 
outcome. He can change one cr more of his answers, while noiding the 
remainder constant, reruns the data and sees what effect the changes have 
on the final outcome. The current value for the choices can be saved for 
comparison with the new values. To change the data he presses [Cj. He will 
be asked if he wishes io save the current values for comparison with the 
new ones he wiil De calculating. TRAFUSi will then display a list cf all of the 
information he the user provided by answering questions. Then he enters 
the number of the statement he wants to change and the expert svete will 
reask that question. By answering the question with the new values that he 
wishes to try, the program will return to the display of all of the information 
that he told it. The user continues changing statements until the data is the 
way he wants it, then presses [R] to rerun the data. If, due to the changes, 
the program realizes that it needs more infor mation, it will ask for it. The 
rules will not be displayed during the rerun. The program will then display 
the new list of choices. If he opted to have the previous values for 
comparison, they will be displayed in parenthesis. 

He can change the data again in almost the same way. The only 
difference is that when he presses [C] he will be given three options: 

1. Keep the original values for comparison. 
2. Keep the most recently calculated values for comparison. 


3. Don't keep any comparison data. 
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The ability to change and rerun the data allows the user to test the expert 
system and see if an answer that he were not sure of is vital to the final 
outcome, or really has little effect. He can save a printed copy of the results 
of the run by pressing [P]. Then he will be asked if he wishes to have the 
data he told the expert system also printed. If he presses [Y] he will have 
both the final sorted list of choices printed along with all of the data he 


provided the expert system in answer to its questions. 


F. SAVING DATA AND RESULTS 

The user has the option of storing the data he has input into TRAFUS1, 
exiting the program, and being able to return to the same point later. This 
can be useful if ne needs to look up information needed by TRAFrUS! or if he 
must leave the program Dut don't want to loose the data he has already 
input. He can select to store the data by entering QUIT in response to any of 
the program requests for data. The program will then ask for the name of 
the file to store the data in. A filename of up to 8 characters ( different than 
TRAFUS!) is needed to be entered. Then he will be asked if he wishes to 
return to the program or exit to DOS. Also he can store the input provided to 
reach the conclusions by oressing {Qj. This is the same as using the QUIT 
option when entering data. The data input will be stored in a disk file and 
he will be able to return directly to this point. This is particularly useful if 


he wants to experiment with the “ change and rerun’ command. 
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X. TRAFUS2 


So far, in TRAFUS1, for the representation of facts and of methods for 
deducing new facts from oid ones, we have almost always assumed that 
either a fact is Known to be true, or it is Known not to be true (or nothing at 
all is known about it). We have essentially not considered the possibility 
that we mignt Know something that is " propabiy true ". However, there are 
Situations in which such knowledge is important. 

In TRAFUSZ, An ad hoc approach is used, using the EXSYS 0-10 system. 
The systems uses numerical assignments to assertions, which expressing the 
degree of belief of the expert in these assertions. It is considered as a 
certainty factor which expresses the degree of confidence about a certain 
hypothesis. So, TRAFUS2 is generally similar to TRAFUS1, but the only 
difference is that the value following the “probability=" is a ratio where the 
denominator is 10. This is the most practical system. 0/10 is equivalent to 
“certainly false” and locks the value at 0/10 regardless of any other value 
the choice may have received. A value of 0/10 eliminates the choice from 
further consideration. A value of 10/10 is equivalent to ‘certainly true and 
also locks the value for the choice at 10/10 regardless of any other values 
the choice may have received. Values of 1 to 9 represent degrees of 
certainty ranging from “very probably false” to “very orobably true’. The 
vaiues from 1 to $ do not icck the value and are averaged to give the [final 
value for a choice. 

For example, if a choice appears in three rules that had true IF parts with 


values of 3/10, 8/10, and 4/10, the final value for the choice will be the 
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average: 5/10. If the values found were 3/10, 9/10 and 0/10, the 0/10 
would prevail and result in a final value of 0/10 regardless of other values. 
Likewise, if the values were 1/10, 3/10 and 10/10, the 10/10 would lock 
the value at 10/10 regardless of the previous lower values. Values of 1-9 
are averaged to a final value only if not over-ridden by a 0/10 or 10/10. 
The first 0/10 or 10/10 prevails and will not be changed even by another 
10/10 or 0/10. 

In developing TRAFUS2Z, several questions have arisen and needed 
answers, among these questions are: 


1. How to convert from human terms to numeric certainty factors. For 
exampie, what does It is very likely that " mean? 


2. How to normalize across different people's scales, particulariy if the 
solution to question | is to get people to provide numbers directly. 


3. How far to propagate changes in the Confidence Factor (CF) on the basis 
of new evidence. If the CF{h ,e] changes very slightly and h is part of 
the relevant evidence for another hypothesis, h, should CF{h,e] also be 
changed? If very tiny changes are always propagated as far as possible, 
the system may spend all of its time doing that with very little impact 
on the final outcome. On the other hand, many small changes can add 
up to a significant change that should not be ignored. 


4. How to provide feedback to the database to improve the accuracy of the 
CF’s of the rules. This problem has been particularly solved in MYCIN 
by the TEIRESIAS system's ability to explain the reasoning process to a 
physician and then to accept statements from the physician about how 
the rules should be revised. 


For the solution of problems 1, 2, and 3, the word description of certainty 
shown in Figure 10.1, is used. For soiving problem 4, the capability of 
EDITXS in EXSYS is used. Figure 10.2, shows the results obtained from a run 
of TRAFUS2. 
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FIGURE 10.1. Werd Description cf Certainty in 0-10 System 
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FIGURE 10.2. Results Obtained from a Run of TRAFUSZ 
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XI. CONCLUSIONS 


In this dissertation, a new efficient and reliable distributed estimation 
architecture for Distributed Sensors Networks (DSN) has been presented. [t 
is called Horizontal Estimation Architecture (HEA). HEA is introduced 
bearing in mind the technoicgical advances in several disciplines, which are 
providing the future tools for designers of DSN, especially, the application of 
artificial intelligence and Knowledge manipulation, and the adoption of 
decentralized decision making strategies in complex technological 
environments. [n addition, the communication load is minimized between 
different nodes of a network by exchanging locaily processed data between 
these nodes instead of raw data. Also, the HEA is developed bearing in mind 
the possibility of any hostile enemy actions, including physical destruction 
and electronic countermeasures which can create node and link failures and 
a dynamically changing network topology which are essential requirements 
for military systems. 

A great motivation to HEA is the applicability of partitioning approaches 
which allow any large compiex system to de divided into manageable 
proportions. The partitioning allows the usage of microcomputer systems, 
which provide a cost-effective solution for data processing. Cbvious 
advantage of HEA as applied to DSN are local autonomy, heterogeneous 
feature, reliability, and survivabilitv. Network splitting and reformation or 
connection of additional compatible networks are practicable during system 


operation and do not cause any restrictions as the new system is 
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initiated. The main concepts and features of HEA were presented in two 
conferences [Ref. 82, 83]. 

Through the integrated view of the assets of a DSN as shown in Figure 2.4, 
the HEA has been applied to TWS radar systems. This application shows the 
effect of the partitioning approach used by solving the multitarget tracking 
problem at the sensor (node) leve! using the appropriate local estimation 
algorithm. This guarantees the maximum utilization of the local resources of 
each radar site and takes advantage of the advanced techniques taking place 
in each major block of aradar system. When the multitarget tracking 
problem is solved separately for each individual node, a somewhat 
redundant view of the surveillance area will result, depending on the degree 
of overlapping coverages between the radars. The output of the local 
estimator is a group of different tracks. By solving the multitarget tracking 
problem separately for each individual sensor (node), the track estimates for 
the targets in the surveillance area become consolidated first at the level of 
each individual node. 

A major component of HEA is the information fusion process. The 
information fusion process decides whether more than one track from 
- different nodes represent the same target. A pairwise correlation technique 
is used for and proved to be easy to implement. The corresponding 
consistent tracks are combined together. Two techniques are used for 
information fusion. The first is based on algorithmic processing of track 
Kine matic information, and it is proved that the fused estimates can be 
considered the global estimates of the tracks in the overlapping area 


assuming that the local estimates are optimal. It is also proved that there is 
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no need for the calculation of the cross covariance of the fused tracks since 
the local estimates and its associated covariance are the kind of information 
exchanged between different nodes. The second technique is based on 
heuristic reasoning by using expert systems to encapsulate target identity, 
behavior, intent and human expertise in computer software. An EXSYS 
expert system development package is used for this purpose. EXSYS 
employs Al techniques using currently available hardware and software. It 
does not require the complexity and cost of LISP driven architectures, nor is 
there is a need for large on-site support staff. The developed expert systems 
can be used mainly as an advisory tool for the manual operator. With 
modifications, it may directly control the fusion process autonomously. 

Using the expert system approach, the correlation process can be easily 
implemented using simple production rules. The emphasis in the programs 
TRAFUS1 and TRAFUS2 has been on the fusion of track information, but 
fusion processes, especially in military applications, must integrally overlap 
with planning, ECM effects, tactical doctrine, operational limitations, logistics 
and historical reconstruction/analysis processes. The modification and 
augmentation of these into expert systems can be done. 

Further research is needed for the application of HEA in systems which 
have different kinds of sensors. Also, many different kinds of knowledge 
engineering approaches are being applied to the various facets of 
information fusion problems. The data structures of the applicable expert 
systems vary greatly, and, in general, talk among these systems has not 
occurred. A considerable research effort is needed to establish a common 


ground for these systems to enable them to communicate with each other. 
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Another consideration about developing an expert system is tacit 
knowledge. Tacit knowledge has implications for knowledge elicitation 
within the current state of the art. One implication arises out of the 
invisibility of the relation between formal Knowledge and skilled 
accomplishments, our lack of awareness of our own skills, and our frequently 
misplaced respect for theory-like representation of what we believe we 
know. The only solution to the problem demands that the knowledge 
engineer must do more than tap the knowiedge of the expert, Dut must 
undertake at least a short apprenticeship, a period of participation as an 


observer, as part of the elicitation process. 
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APPENDIX A 
THE SPECTRUM OF SENSORS AVAILABLE FOR DATA FUSION 


Non - Nuclear 
Particles 


lyaz 


Detectable Spectral Sensor Systems 
Characteristics Range 
ACOUSTIC 1 dz- 10 kHz Acoustic Detectors 
Frequency Active/Passive Sonar 
Seismometers 
Electromagnetics 1 Hz- 1 MHz (LF) Magnetometers 
Radio Passive ESM 
Frequency(RF) Receivers 
10 MHz - 100 MHz Radar (Monostatic, 
(HF/ VHF/UHF) Muitistatic ) 
1 - 10 GHz - Surveillance 
10 - 50 GHz (SHF/EHF) - Fire Control 
30 - 300 GHz (MMW) Millimeter Radar 
Radiometers 
InfraRed 300 - 10) IR Radiometers 
Wavelength (IR) -Scanning IR Search 
Track 
-Focal Plane Arrays 
Visible Light 07-040 Lazer Radar 
UltraViolet ( UV) 0.4 - 3x 10-30 EO Sensors(TV) 
UV Spectrometers 
Nuclear 3x 102 - 3x 10-4 A x ~- Ray Detectors 
Paticies Gamma Ray Detectors 


Mass Spectrometers 


APPENDIX B 
OVERVIEW OF TKISOLVER 


Computer-assisted problem- solving typically goes through the following 

steps: 
Problem — Mathematica! Mode! = Algoritht = Program ~— Resuits 

The first step, based on the analysis of the problem, is to set up a 
mathematical model expressing the relationships between the variables. 
Then an algorithm (a precise description of how a computation is to proceed) 
must be developed for solving specific problems. Next a program 
implementing the algorithm 1s written in a conventional program ming 
language (e.g. BASIC, FORTRAN, or PASCAL). Frequently, the programmer 
uses a diagram called a flowchart” to facilitate the design and understanding 
of the algorithm or the program structure. A considerable amount of time 1s 
spent in these two stages, especially in the programming stage when the 
computer must be instructed in a step- by- step manner. Finally, of course, 
the program has to be debugged and run. All this means that a user has to 
“think like a computer” to solve a problem. This siphons a lot of time into 
other tasks necessary for fixing an unmatched parenthesis or formatting the 
output correctly. Solving a slightly different problem often means modifying 
the program and sometimes even reworking the algorithm. 

TK!Soiver shortcuts this problem-solving process by eliminating two steps, 


developing an algorithm and writting a program. Instead, the user inputs 
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the mathematical mode! directly using standard algebraic notation. By this 
way, the user and the computer interact at the level of mathematical models 
or relationships between variables and the computer automatically takes 
care of sequencing the operations. So, [K!Solver lets the user focus on the 
problem itself. not on how the problem is going to be solved using the 
computer. The “TK” in TK!Solver stands for Tool Kit, implying that there are 
several problem-solving tools in the kit and more to be expected. The 
exclamation mark refers to the Action Kee, which is pressed to solve a 
problem or to make other things happen. TK!Solver solves problems for 
professionals working With numbers and formulas. It does this by 
processing equations entered in their natural form [Ref. 84]. 

Considered as an expert system [Ref. 84], figure B.1. shows the 
architecture of TK!Solver. The domain specific knowledge responsible for the 
high perfor mance of the system is contained in the knowledge base. The 
problem solving tools embodying the control strategy, the direct and 
iterative solvers, utilize the knowledge base in the process of solving 
particular problems. For interaction (or I/O), TK!Solver provides “sheets” 
displayed through one or two windows on the screen. The main feature of 
the architecture is the explicit division Detween the knowledge base and the 
control strategy. Consequently, the expert/user deals only with issues of 
domain specific knowledge, and is insulated from the details of the 
implementation of the control strategy. 

In the following paragraghs, the four components of the knowledge base, 
the characteristics of a model and the problem-solving mechanism are 


described: 
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. Rules: The rule is the basic component of the domain-specific 
knowledge. It expresses the underlying mathematical relationship in 
terms of the equality of left-hand and right-hand side expressions. 
Equations, constraints, or definitions may all be represented as rules. 
The set of rules can be represented in the form of a network of 
relationships called R-grapoh (for relationships graph). A variable is 
represented Dy a node in the R-graph and each subgraph or poiygon 
corresponds to a rule in the knowledge base. 


. Unit Conversions: Units of measurement are associated vith most 
measurable quantities. Conversions between them are frequently 
encountered in preblem solving and have to be defined in ithe 
knowledge base. The unit conversion feature in TK!Soiver simplifies 
the conversion between the different units of measurement. 


. User Functions: Empuiric relationships between sets of variables are 
expressed in the form of user-defined functions. 


. Built-In Knowledge: Irrespective of the domain-specific knowledge, 
Tk!Solver can solve problems invoiving basic arithmetic operations and 
a large variety of built-in mathematical functions. For example, 
trigonometric functions, hyperbolic functions, exponential function, root 
function, natural and decadic logarithms and circular or inverse 
trigonometric functions. A standard variety of these 1s supplemented 
by afew special ones like ‘element’ for retrieving list components or 
“apply for associating empiric functions with arguments. 


. Model: The mode! encompasses the first three components of the 
knowledge base in Figure B.1. (rules, unit conversions, user functions) 
as contained in the rule, variable, unit, and user function sheets. [n 
more generai terms, the mode! can De seen as a compact, digh-level 
representation of structure, organization, and content of the domain 
knowledge. The composition of the model! coupled with its elegant 
internal representation allow for a simple yet powerful control 
strategy. The mode! also serves as a user- friendly guide during the 
problem-solving precess. The mode! usuaily reflects a certain part of 
the knowiedge Dase in a particuiar discipline. The modeis may 5e 
easily merged by the subsequent loading of some or all of the 
knowledge base components into [K!/Solver, in order to create larger 
models capable of addressing more complicated problems. There is 
also the concept of TK/Solver packs or sets of models from particular 
disciplines. 


re 


«model ::= <rule o[{{newline)< rule >}] 

This means that a model consists of at least one rule; each rule must 
start on a new line, and there may be any number of lines between the 
rules. 

<rule> ::= < expression >=< expression >[< comment >] 

This means that arule is represented by two expressions linked by an 
equai sign and foilowed, optionally, by a comment. 

<comment> ::= °< character string > 

This means that a rule comment consists of a quotation mark {") 
followed by a string of characters. 


. Probiem-Soiving Mechanism: The direct solver is the workhorse of the 
problem-solving mechanism. I[n it lies the grace and power of 
TK!Solver. It manipulates the equations depending on the problem 
formulation and solves for the unknown. If an incosistency error or an 
ulegal operand is detected, the solution orccess is terminated, and the 
ruie causing the probiem its flagged with the arppropriate error 
message. Since the soiution path descends on the problem formulation, 
the control strategy may be considered as forward chaining or data- 
driven. Whenever the direct solver cannot match the nature and 
complexity of a given problem, the iterative solver can be used. The 
heart of the iterative solver is a modified Newton-Raphson procedure 
which handles sets of simuitaneous linear and nonlinear equations []. 
It can be either explicitly invoked or automatically called when the 
direct solver fails to produce a soijution. 
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UNIT CONVERSIONS ITERATIVE SOLYER 
USER FUNCTIONS 
BUILT-IN FUNCTIONS 





EXPERT 
SYSTEM 


FIGURE B.1. Functional Diagram Of TK!Solver - User Interface 
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APPENDIX C 
PRODUCTION RULES 


In most areas of human decision making, the reasoning processes can be 
modeiled by rule-based systems. A rule, Known in these applications as a 
“production rule" or a ‘production’, is generally of the form 


IF Fy, and Fo and ---.-.---- andF, THEN C 


or equivalently, 


where F; is a fact, an event, a situation, a string of symbols, or a cause, and C 


is a conclusion or hypothesized conclusion, an action to be performed, or an 
effect. Some of the rules in a production system represent the knowledge of 
trained experts, and others provide system organization. 

In addition to an organized set of rules, a production system must have a 
data base consisting, typically, of gathered pieces of evidence which might be 
relevant to the condition in the left side of some rules. System organization 
is provided by several kinds of control mechanisms. An evaluation 
mechanism is needed to evaiuate the left side of a rule based on the 
evidence in the data base. It is desirable to have a mechanism for 
augmenting and modifying the system. A production system also needs 
direction and weighting mechanism. 

Figure C.1, is an illustration of a tree structure of a very simple production 
system. The AND arcs denote single productions (where multiple conditions 


must be satisfied for the conclusion to follow), and OR inputs are separate 
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productions. The “direction” mechanism of a production system relates to 
reasoning processes, where inferring and deducing new information from 
evidence can be considered opposite in direction from hypothesizing and 
then testing the hypothesis. One type of system direction is forward 
chaining or running; these systems start with input data and proceed up to 
conclusions. Backward chaining (running), or top down, start with 
hypothesized conclusions that are selectively generated and proceed to see if 
they are supported by the data base. Some systems use an ad hoc 
combination of up and down directions. 

When using a production system, there is often associated with each F; in 
the premise a quantity known as a “certainty factor’, which indicates the 
likelihood that F; is true based on the input data. Also, for most production 
rules, the premise leads to the conclusion with , say, an 80% or 90% 
probability, instead of absolutely true or false. Similarly, there may be 
significant probability that the conclusion is true even when the premise is 
not satisfied. Measures of the latter two likelihoods are known as 
“strengths”, “attenuation factors’, or “certainty factors’. All of these 
quantities can be used in estimating the certainty factor of a conclusion. 
Many conclusions are intermediate conciusions that are then treated as facts 
for future productions. “Weighting” is a term that refers to these quantities 
and their propagation through the tree. Weighting can be used to determine 
the reliability of final conciusions and also to reduce the number of 
computations through the pruning of unlikely hypotheses. If the statistics 
of the process are known sufficiently, Bayesian weighting can be used. A 


more common method of weighting is to use ad hoc scoring functions. When 
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the conditions F; or the evidence about them cannot be considered 
independent, fuzzy set theory can be applied. For example, the fuzzy set 
computations P(F), «-----. , F,) = min P(F;) can be used at the AND nodes. 

An advantage of a production systems 1s that it can be designed to 
provide high user confidence. The user can read the lists of rules and can 
question any conclusion, and the system can present to him the facts and 
logicleading to the conclusion. If he disagrees he can change the rules; with 
an appropriate mechanism for modification and augmentation. modular 
pieces of knowledge in the form of production rules can be added or changed 
without difficulty. In automated fusion applications, these system attributes 
are especially important. A user is unlikely to accept the sysiem's conclusion 
if does not understand the Icgic behind it or previous conclusions. And he 
must be able to correct or refine the system and to incorporate new 
knowledge into the system when changes occur in hostile force procedures 
or equipment. 

Aside from the obviously difficult task of acquiring rules, there are 
several special problems that will be encountered in applying production 
systems to fusion problems. At the svstem front-end there is the problem of 
evaluating the left side of a rule based on the conceptually structured data 
obtained through the processing of natural language reports. In platform 
identification applications, much of the data wil! be inaccurate or even 
totally wrong because of deceotion or human error. Moreover, conclusions 
will often have to be updated because of the continual arrival of data. There 


are also the geometrical problems of track association to be solved, but these 
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Probably the greatest problem with production systems or any automated 
system is that there are innumerable nonroutine situations which could 
occur. While a human might be able to fuse the data in an intelligent way in 
many of these situations, he probably would not be able to foresee the 
possibility of these situations in time to incorporate the necessary knowledge 
into an automated system. Generally, it seems that “blackboards” is a proper 


starting way for solving these problems. 
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FIGURE C.1 Trees of Conclusion in a Production System 


182 


APPENDIX D 
OVERVIEW OF EXSYS 


EXSYS is a generalized personal computer expert system development 
package(Ref. 85]. It works on [BM PC, XT, AT or compatible. [t can create 
about 700 rules, vith an average oi 6 or 7 conditions, per 04k of memory 
over 192k. That is about 5000 rules in a PC with 040k. The EXSYS programs 
are written in the C language producing small, fast running programs. The 
EXSYS development package consists of four main programs: 

EXSYS.EXE: The runtime program for running existing expert systen 
knowledge bases 

EDITXS.EXE: The program for generating, editing and testing your own 
‘expert system knowledge bases. | 

SHRINK.EXE: A utility program to compress the size of an edited knowledge 
base and rearrange the data in a knowledge base for rapid access. 
FASTER.EXE: A utility program to rearrange the order of rules for 
maximum speed. 

Expert systems work with knowledge io arrive at conclusions. This 
Knowledge is in the form of rules that both the user and the computer can 
understand. The set of rules to solve a particular problem is often referred 
to as a Knowledge dase. A ruie is divided into five parts, an IF part, a THEN 


part, an optional ELS# part, an optional NOTE and an optional REFERENCE. 
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IF 
Condition 


THEN 
Conditions 


ELSE 
Conditions 
and Choices 


The [¥ part is simply a series of conditions, expressed as English 
sentences or algebraic expressions. The computer tests the conditions 
against the answers provided bv a user and information that.can be derived 
from other rules, to see if the IF conditions are true. Tne THEN part is aiso a 
series of conditions; however, there can also be choices with their associated 
probability values. The ELSE part is the same as the THEN part but ts 
applied if any of the IF conditions are false. The ELSE part is optional and 
usuaily not needed in most rules. In some cases :t is desirable to add a note 
to arule to provide some special information to the user. If there is a NOTE, 
it will be displayed with the rule. The NOTE does not mean anything to the 
orogram, it is only for the user's information. The developer of the expert 
system knowledge dase may aiso add a REFERENCE for arule. This 1s 
intended io help the user find the source of the knowledge contained in the 
rule or ncere information if they shouid need it. The REFERENCE is 
displayed only if the user requests the reference: it is not automatically 
displayed with the rule. 

To understand how the EXSYS expert systems are generated, it 1s needed 


to understand the definitions of the following terms: 
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1. Condition: In EXSYS, there are two main types of conditions, text and 
mathematical. For text, the condition is made up of two parts, a 
QUALIFIER and one or more VALUES. The qulifier is usually the part 
of the condition up to and including the verb. The values are the 
possible completions of the sentence started by the qualifier. A 
qualifier can have up to 30 possible values. If the developer finds that 
he needs more than 30 values, tries to divide them into groups each 
With less than 30 values. Then create a qualifier that selects among 
the groups and use it in conjunction with new qualifiers for each of the 
individual groups. When a new qualifier is created in EXSYS it is given 
a list of possibie values such that combining the qualifier with a value 
(or values) makes a sentence. When more than one value is selected, 
the program will pu ‘or’ between the values and, if any one of the 
listed values is true the condition will be true. A condition can also be 
formed by using a qualifier, “NOT” and one or more values. The 
selection of qualifier and values should be such that combining them 
with NOT, OR or AND makes a grammatically correct sentence. For 
mathematical conditions, they are represented as algebraic 
expressions. The mathematical expressions usually include 
VARIABLES. A variable is any string of alphanumeric characters, 
including spaces, enclosed in [ J. The first 18 characters are significant 
but the variable can be up tol00 characters. Only letters, digits and 
spaces can be used in variable names. In this case the variables are 
used to create evaluable algebraic expressions. An evaluable 
expression can be any algebraic expression from a single number to 
complex expressions. The following operators are recognized: 

* (multiplication 

/ (division) 

+ (addition) 

- (subtraction) 

% (modulus operator) 
Parentheses can be used to group expressions in the order of 
calculation the developer desires. Spaces can be included between 
operators to make the formula easier to read. The following functions 
are supported: 

SIN( ) 

COS( ) 

TAN( ) 

ASIN( ) 

ACOS( ) 
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ATAN( ) 

EXP( ) 

LOG( ) 

ABS( ) 

SQRT( ) 

INT( } 
Tne trigonometric expressions are in radians. The log and exponential 
functions are base e. ABS is the absolute value. SQRT is the square 
root. INT is the integer part, with all fractions rounded down. The 
functions evaluate the expression in parentheses and perform the 
appropriate function on the result. The parenthetical expression must 
immediately follow the function name, without a space. A rule can 
have up to 126 conditions in each of its IF, THEN or ELSE part. 


2. Choice: Choices are all the possible solutions to the problem among 
which the expert system will decide. The goal of EXSYS is to select the 
most likely choice based on the data input, or to provide a list of 
possible choices arranged in order of likelihood. The choices can be of 
any form, item, actions, etc., depending on what type of expert system 
is geing developed. EXSYS will display the text of the choice followed 
by “- Probability=" and anumber. The number indicates the 
confidence that the choice is correct and is 0, | or aratio such as A/B. 
The denominator, B, indicates the maximum possible value (either 10 
or 100) in the calculational system being used. The numerator, A, is 
the probability value assigned to the choice. The person generating the 
knowledge base must select one of three options for how the program 
will use the probability data. 


The rules are automatically invoked using backward chaining. EXSYS also 
supports forward chaining. External programs can be called by EXSYS for 
data acquisition and calculation and data can be passed back to EXSYS for 
analysis. This powerful feature enables it to handle a wide range of 
problems. The expert system can directly receive data from automatic 
testing equipment, data bases, some spread sheets and dedicated programs. 
There are two ways to call external programs from the expert system. The 


simplest is used to get data for a single variable or qualifier. The second 
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method is intended for obtaining data for a number of variables or qualifiers 
such as might be done with a data base, spread sheet or automatic test 
equipment. Both can easily be used with a wide range of programs and 
program ming janguages, inciuding BASIC. There must be enough memorv 
available for both EXSYS and the program called torun. EXSYS remains 
resident in memory while the called program runs. 

Blackboarding is a powerful technique by which more than one knowledge 
base can share a common body of information. This can be done in EXSYS 
by having one one knowledge base write data to a file that ts read by other 
knowledge bases, In version 3.1, special command options have been added 
to make this easier to do. There are two basic ways of controiling the order 
of execution of the various knowledge bases. The first is through the use of 
a batch file. This is appropriate if the knowledge bases are intended to be 
called in a specific, defined order. Batch files can include loops to restart the 
system. The second technique is to have an EXSYS expert system call other 
EXSYS expert vam: This is the most powerful technique, as the order of 
excution of the knowledge bases can be varied depending on what is needed. 
Blackboarding requires care in making sure that the knowledge bases 
sharing the information each assign the data correctly, however, the benefits 
in being able to segment a problem and allowing extremely complex systems 


to be run in a PC make the technique quite worth while. 
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APPENDIX E 
SAMPLE OF TRAFUS! PRODUCTION RULES 


Subjece: 
Hard Decision Knowledge-Based Multitarget Multisensor Track Fusion 


Author: 
Alaa Eldin M. Fahmy 


starting text: 
This Expert System is an experimental system to explore the 
applicability of artificial intelligence techniques to the 
implementation of an automated, extremely flexible track fusion 
consultant. The expert system fuses tracks from three different TWS 
systems, A,B,C. Each system has two different tracks, resulting in a 
total of 6 tracks. The tracks are Al,A2,B1.82,C1,.C2 from) Woeeeess 
A,B,and C respectively. TWS sites are covering large air-space areas 
with partially overlapping fields of view. Track fusion is based on 
kinematic, attribute and behavier information. 


Ending text: 
The expert system will display which tracks are the same and to which 
target they are belong. In addition to whether targets are friendly 
or hostile targets. 


Stops after first successful rule in data derivations. 
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RULES : 


2eee@ee#ee#eede@eeeeststseeeeqaeeseeeaoare@ge@ee@e”W@seeteeees@ees2e2 2 22 2 @ 


PULE NUMBER: 1 


af: 
and 


and 
and 


he N 


and 


BESE; 


and 
and 


ABS([RA1]-{RB1}) <= .15 
ABS({PHIA1]-{PHIB1]) <= 2 
ABS({SPEED OF Al]-(SPEED OF B1l}) 
(IDAl] = [IDB1] 


<= 20 


Tracks Al and Bl are for the same target - Probability=1 
Targets al and bl are one target 


Track Al is for target al - Probability~=l 
Track Bl is for target bl - Probability=l 
Targets al and bl are different targets 


2 @2q@we@qee@ed@ee@eee@ed@e@eeseeeeeteweseeqeeseses®2s2®e2s2eoes « 


RULE NUMBER: 2 


ee 
and 


and 
and 


HEN : 


and 


Heese? 


and 
and 


ABS([RAl1]-[{RB2]) <= .15 
ABS([{PHIA1]-[PHIB2]) <=2 

ABS([SPEED OF Al]-[SPEED OF B2]) <= 20 
[IDAl] = [IDB2] 


Tracks Al and B2 are for the same target - Probability=1 
Targets al and b2 are one target 


Track Al is for target al - Probability=1 
Track B2 is for target b2 - Probability=1 
Targets al and b2 are different targets 
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RULE NUMBER: 8 


EPS 
ABS([RA2]-[RC2]) <= .2 
and ABS([PHIA2]-[PHIC2]) <= 3 
and ABS([SPEED OF A2]-(SPEED OF €2)))<=.20 
and [IDA2} = [IDC2] 


THEN: 
Tracks A2 and C2 are for the same target - Probability=1 
and Targets a2 and c2 are one target 


ELSE: 
Track A2 is for target a2 - Probability=1 
and Track C2 is for target c2 - Probability=l 
and Targets a2 and c2 are different targets 


RULE NUMBER. 9 


oe 
Tracks Al and Bl are for the same target 
and Tracks Al and Cl are for the same target 


THEN: 
Tracks Al, Bl, and Cl are for the same target 
and Targets al, bl, and cl are the same and they are one target 


RULE NUMBER: 10 


oe 
Tracks Al and B2 are for the same target 
and Tracks Al and Cl are for the same target 


EEN: 
Tracks Al, B2, and Cl are for the same target 
and Targets al, b2, and cl are the same and they are one target 
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RULE NUMBER: 11 
IF: 


Tracks Al and Bl are for the same target 
and Tracks Al and C2 are for the same target 


THEN: 
Tracks Al, Bl, and C2 are for the same target 
and Targets al, bl, and c2 are the same and they are one target 


RULE NUMBER: 12 
ice : 


Tracks Al and B2 are for the same target 
and Tracks Al and C2 are for the same target 


THEN: 
‘Tracks Al, B2, and C2 are for the same target 
and Targéts al, b2, and c2 are the same and they are one target 


RULE NUMBER: 13 
lop 


Tracks A2 and Bl are for the same target 
and Tracks A2 and Cl are for the same target 


THEN : 
‘Tracks A2, Bl, and Cl are for the same target 
and Targets a2, bl, and cl are the same and they are one target 


ewe @eeseeseeeaeeqe@ee#eoe2veeweeeeeeeeseeaseeveeeseeeweseeeesee ee @ 
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RULE NUMBER: 18 


ce 


and 
and 
and 


THEN: 


and 


Bios: 


LE 


and 
and 
and 


HENGE 


and 


Loe 


Track Bl is for a target not filed tm ene tlteheeoeae 
Target of track Bl is not responding to IFF or SSR 

The position of track Bl is outside all airliner airways 
Track Bl is comming from WEST 


Track Bl is for a hostile aircraft - Probability=l 
Alert friendly forces - Probability=l1 


Track Bl is for a friendly aircraft or an airliner = Probabmieeaee 


exee@ee@eee@ede@e@ee@eeeaeaeqd@e@rveosa2aeq@weee#ed@eds@eees#e@ea@e@e 297 2 2 & 


' RULE NUMBER: 19 


Track B2 is for an aircraft not filed in the flight plan 
Target of track B2 is not responding to IFF or SSR 

The position of track B2 is outside all airliner airways 
Track] B2 is comming s2rom, West 


Track B2 is for a hostile aircraft - Probability=1 
Alert friendly forces - Probability=1 


Track B32 is for a friendly aircraft or an airliner - Probability 


eo eeeeeeeoedqeeeeeoooweeewweeaet_eaeww@egeaesweeerweae@eessgsess 222 82 
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RULE NUMBER: 20 


EES 


and 
and 
and 


THEN: 


and 


ELSE: 


Track Cl is for a target not filed in the flight plan 
Target of track Cl is not responding to IFF or SSR 

The position of track Cl is outside all airliner airways 
Track Cl is comming from WEST 


Track Cl is for a hostile aircraft - Probability=1 
Alert friendly forces - Probability=l 


Track Cl is for a friendly aircraft or an airliner - Probability=l 


, 
ee ese 2 @eewe#seeve#es#es#se#ese#e8s#esws2® @BSeweswFeeFeeFsgese#ee@seseenesns 87 837 832 832 832 2 


RULE NUMBER: 21 


nee 


and 
and 
and 


THEN: 


and 


BESE: 


Track C2 is for a target not filed in the flight plan 
Target of track C2 is not responding to IFF or SSR 

The position of track C2 is outside all airliner airways 
Track C2 is comming from WEST 


Track C2 is for a hostile aircraft - Probability=1 
Alert friendly forces - Probability=1 


Track C2 is for a friendly aircraft or an airliner - Probability=1 


Pier NUMBER: 22 


or: 


THEN: 


ABS([{SPEED OF Al]) <= 50 


Track Al is for a HELICOPTER 
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RULE NUMBER: 27 
be 
ABS( [SPEED OF C2]) <= 50 


THEN : 
Track C2 is for a HELICOPTER 


= 2 2 2 2 2 2 82 82a 828278327 2-937 2 2 2 2 2 2 2232 82 82 2 829392 82 927° 2 2° 82 82° 2 828 292° 2 2 8 


RULE NUMBER: 28 
ie. 


50 < ABS({SPEED OF Al]) <= 200 


THEN: 
Track Al is for a CIVIL AVG 


RULE NUMBER: 35 


3s 
200 < ABS({SPEED OF A2]) <= 400 


THEN: 
Track A2 is for a BOMBER 
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ee ee eee 


QUALIFIERS: 


iL Tracks Al and Bl are 


for the same target 


Used in rule(s): Q gk 


2 Tracks Al and Cl are. 


for the same target 


Used in rule(s): 9 LO 


3 Teacks Al, Bl, and Cl are 


for the same target 


Used in rule(s): (¢ 9) 


4 Targets al, bl, and cl are 


the same and they are one target 


Used in rule(s): (¢ 9) 
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Ly Tracks A2 and B2 are 


for the same target 


Used in rule(s): 14 LS 


44 Track A2 is 
for a target not filed in’ the iligmesp lan 
for a target filed in the flight plan 


Used in rule(s): ey 


47 Tack ac 2s 


comming from WEST 
comming from EAST 
comming from NORTH 
comming from SOUTH 


Used in rule(s): ye 


69 Track Al is 


for a HELICOPTER 
for an INTERCEPTOR 
for a BOMBER 

fora CIVZLSAS 
for a MISSILE 


Used in rule(s): «@ 22)0iGe2eme (new ( 40) 
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VARIABLES : 
ee. 

Rl is the range of track Al at time t 
Displayed at the end of a run 


Used in rule(s): 


eee ke 
Ropis the range of track Bl at time t 


Used in rule(s): 


Ea eT. 
PHI1 is the bearing of track Bl at time t 


Used in rule(s): 


om PHS 
PHI3 is the bearing of track Bl at time t 
Displayed at the end of a run 


Used in rule(s): 


5 rou 
ID1 is the identity of track Al 
Displayed at the end of a run 


Used in rule(s): 


oe US 
ID3 is the identity of track Bl 
Displayed at the end of a run 


Used in rule(s): 
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FORMULAS : 


1 ABS(R1-R5) <= 


Used in crurers). 


2 aABS({R1]-{R5]) <= .15 


Used in rule(s): 


3 ABS({PHI1]-[PHI3]) <= 2 


Used in rule(s): 


4  [ID1] = [1D3] 


Used in rule(s): 


5 ABS({SPEED OF Al]-{SPEED OF Bl]) <= 3 


Used in rule(s): 


Gy SABSCIRU (R72) <= eS 


Used in rule(s): 
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APPENDIX F 
SAMPLE OF TRAFUS2Z PRODUCTION RULES 


suo yect: 
Soft Decision Knowledge-B8ased Multitarget Multisensor Track Fusion 


Author: 
Alaa Eldin M. Fahmy 


Bearcing text: 

This expert system is the same as TRAFUS1 except that the 
probabilistic reasoning is used. In this case as a degree of belief 
of a rule, a probabilty ratio (0/10 - 10/10) is attached to its then 
part. The expert system obtains the data needed to make a decision by 
asking the user questions relevant to the tracks needed to be fused. 
The user can ask the expert system how it arrived at its final 
decision. The user can easily test and analyze the effect his input 
had on the final outcome. Also, the user can ask why the expert 
system needs to know the information it is requesting. 


Ending text: 
The expert system will display which tracks are belonging to che 

Same target and which are not. The results will be associated with a 
probability ratio as a degree of belief in it. If there are more than 
one solution, they will be displayed according to their relative 
likelihood. Whether the targets are friendly or hostile will be 
displayed in addition to its kind (helicopter, fighter, bomber, civil 
A/C, or missile) 


Uses all applicable rules in data derivations. 
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RULES: 


eww nwewereeweewnweweereeweerewweweaewsweanseeaeeweewewewewenweweenreer wr eer es2 2 = 


RULE NUMBER: 1 


rh 


Kei 


ABS([RA1]-(RB1]) <=.2 


CHEN: 
Tracks Al and Bl belong to the same target - Probability=6/10 
and Targets al and bl are the same target and they are one target - 
Probability=6/10 


Track Al belongs to target al - Probability=//10 

and Track Bl belongs to target bl - Probability=/7/10 

and Tracks Al and Bl belong to different targets al and bl - 
Probability=7/10 


NOTE: 
RAl and RB1 are in kn. 


REFERENCE: 
Col. Fahmy’s Ph.D. dissertation, "seps @oq7” 


eo ewe wees wseweeeegeoeseewsewwes Fenmeewwgseeueveedaees#wseeese ww @ ese 2 @2 2 2 2 2 4 
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RULE NUMBER: 5 
er : 
ABS([SPEED OF Al]) <=50 


DEN : 
Target al is a HELICOPTER - Probability=38/10 


RULE NUMBER:: 6 


oe: . 

503< ABS( [SPEED OF Al]) <==200 
BREN: 

Target al is a CIVIL A/C - Probability=8/10 
REFERENCE: ~ 


Col. Fahmy’s Ph.D. dissertation, Sep. 1987. 


RULE NUMBER: 7 


iE: 

200 < ABS( [SPEED OF Al]) <= 400 
AHEN ; 

Target al is a BOMBER - Probability=8/10 
REFERENCE: 


Col. Fahmy’s Ph.D. dissertation, Sep. 1987. 
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RULE NUMBER: 24 


LE: 


and 


THEN: 


and 


and 


ELSE: 


NOTE. 


ABS (URAL T= Rel pen? 
ABS({PHIA1]-[PHIC1]) <=3 


Tracks Al and Cl belong to the same target - Probability=//10 
Targets al and cl are the same target and they are one target - 
Probability=//10 

Tracks Al and Cl belong to different targets al and cl - 
Probability=4/10 


Tracks Al and Cl belong to different targets al and cl - 
Probability=/7/10 


Bearing information of TWS system C is less accurate than that of TWS 
systems A and B. 


REFERENCE: 


Col. 


Fahmy’s Ph.D, dissertation, Sep. 19672 


RULE NUMBER: 25 


te 


and 
and 


THEN: 


and 


and 


EESE 


ABS ({RA1]-{RC1]) <=.2 
ABS({PHIA1]-{PHIC1]) <=3 
ABS ( (SPEED OF Al)—/ SPEED On Cl) e-=2> 


Tracks Al and Cl belong to the same target - Probability=8/10 
Targets al and cl are the same target and they are one target - 
Probability=8/10 

Tracks Al and Cl belong to different targets al and cl - 
Probability=2/10 


Tracks Al and Cl belong to different targets al and cl - 
Probability=7/10 
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RULE NUMBER: 53 


iE: 
ABS([RA2]-[{RCl1]) <=.2 
and ABS([PHIA2]-[{PHIC1L]) <=3 
and ABS({SPEED OF A2]-{SPEED OF Cl]) <= 25 
and [IDA2] = [IDC1] 


THEN : 
Tracks A2 and Cl belong to the same target - Probability=9/10 
and Targets a2 and cl are the same target and they are one target - 
Probability=9/10 


BoE : 
Tracks A2 and Cl belong to different targets a2 and cl - 
Probability=10/10 


RULE NUMBER: 60 


es 
Meagceesee tS Por an aircraft not filed in the flight plan 
and Track B2 is for an aircraft not responding to IFF or SSR 


HEN : 

Track B2 is for a hostile aircraft - Probability=7/10 
ELSE: 

Track B2 is for a friendly aircraft or an airliner - Probability=7/10 
REFERENCE: 


Col. Fahmy’s Ph.D. dissertation, Sep. 1987. 
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RULE NUMBER: 68 


be: 
Track Bl 
and Track Bl 
and Track Bl 


THEN: 
Track Bi 


is 
is 
is 


1s 


for an aircraft not filed in the £¥ienteeran 
outside all airliner airways 
outside all airliner airways 


for a hostile aircraft - Probability=8/10 


= 2 ee @o@=wrt wr 2 2®erseeees2 2 we weweeeaewew®aqesws=® 2=®@eos#s 2 2@ewvwee 2 @2 2 2 292 2 4 @ 


RULE (NUMBER A oo 


LP: 

Track Bl 
and Track Bl 
and Track Bl 
and Track Bl 


THEN: 
Track Bl 


is 
is 
is 
is 


is 


for an aircraft not filed in the Elightepian 
outside all airliner airways 

outside all airliner airways 

comming from WEST 


for a hostile aircraft - Probability=9/10 


RULE NUMBER: 70 


cE: 


Track B2 is for an aircraft not filed in the flight plan 
and Track B2 is for an aircraft not responding to IFF or SSR 


THEN = 


Track B2 is for a hostile aircraft - Probability=7/10 
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RULE NUMBER: 88 
ie: 


Track Bl is for an aircraft responding to IFF or SSR 


EN : 
Track Bl is for a friendly aircraft or an airliner - Probability=8/10 


RULE NUMBER: 89 
er: 


Track Bl is inside any of airliner airways 


THEN; 
Track Bl is for a friendly aircraft or an airliner - Probability=6/10 


RULE NUMBER: .90 
Le: 


Track Bl is comming from EAST or comming from NORTH or comming from 
SOUTH 


THEN: 
Track Bl is for a friendly aircraft or an airliner - Probability=9/10 


RULE NUMBER: 91 
rE 
Track B2 is for an aircraft filed in the flight plan 


THEN: 
Track B2 is for a friendly aircraft or an airliner - Probability=9/10 
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QUALIFIERS: 


i 


Track Al is 


for an aircraft filed in the f£liene plan 

for an aircrat® not filed in the flipherotan 
for an aircrart responding co IPF or Ssh 

for an aircraft mot responding ce llr oreo. 
outside all airliner airways 

inside any of airliner airways 

comming from EAST 

comming from WEST 

comming from NORTH 

comming from SOUTH 


Used in rule(s): 57, 63 64 
82 


Track A2 is 


for an aircraft filed in™@the fliche plan 

for an aircraft not, Erled in’ the. Slient plan 
fer an aircraft responding to IFF or SSR 

for an aircrarte not responding to LPR cresce 
outside ail airliner airways 

inside any of airliner airways 

comming from EAST 

comming from WEST 

comming from NORTH 

comming from SOUTH 


Used in rule(s): 58 65 66 
86 
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12 


83 


80 


84 


oa 


85 


CHOICES: 


i 


Track Al belongs to 


Used in rule(s): 


Track A2 belongs to 


Used in rule(s): 


Track Bl belongs to 


Used in rule(s): 


Track B2 belongs to 


Used in rule(s): 


Track Cl belongs to 


Used in rule(s): 


Track C2 belongs to 


Used in rule(s): 


target al 


eee ed 


target a2 


target ol 


[ 1) fC 2] 


target b2 


target cl 


caneec C2 
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VARIABLES : 


ine 

Range of last report of track Al 
Numeric variable 
Displayed at the end of a run 


Used in rule(s): il 2 3 4 LG 
12 iS 24 25 26 
a5 34 


2 SRB 

Range of last report of track Bl 
Numeric variable 
Displayed at the end of a run 


Used in rule(s): a 2 3 4 40 
42 


3 PHIAL 

Bearing of last report of track Al in degrees 
Numeric variable 
Displayed at the end of a run 


Used in rule(s): 2 3 4 PE deZ 
24 2 26 By 55 


ob lape 

Bearing of last report of track Bl in degrees 
Numeric variable 
Displayed at the end of a run 


Used in rule(s): 2 3 4 40 41 
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if 
32 


41 


is 
34 


42 


12 IDB2 

Identity code of track B2 
String variable 
Displayed at the end of a run 


Used in rule(s): NGS 45 


im, RCL 

Range of last report of track Cl in km 
Numeric variable 
Displayed at the end of a run 


Used in rule(s): 24 25 26 Si a2 


toe PHICL 

Bearing of last report of track Cl in degrees 
‘Numeric variable 
Displayed at the end of a run 


Used in rule(s): 24 25 26 oe a2 


FS) SPEED OF Cl 

Speed of track Cl in m/s 
Numeric variable 
Displayed at the end of a run 


Used in rule(s): 25 26 27 Z5 29 
ou a2 5s 


16 IDC1 

Identity code of track Cl 
String variable 
Displayed at the end of a run 


Used in rule(s): 26 ao 
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